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THE BENDER-GESTALT: AN OBJECTIVE SCORING METHOD 
AND VALIDATING DATA* 


FRED Y. BILLINGSLEA 


Tulane University 


INTRODUCTION 


Geometrical designs are composed of 
lines, angles, and curves combined in a 
variety of relationships. Individuals 
see and reproduce the same geometrical 
design differently. Is this difference in 
visual-motor perceptual behavior re- 
lated to differences in individual per- 
sonality? That is the question which 
this study seeks to answer, at least in 
part, by evaluating the Bender-Gestalt 
Visual Motor Test (4). 

It has long been the assumption of 
German psychologists(5,15,19), and the 
concept is rapidly being accepted by 
such American psychologists as Thur- 
stone(19), that an adequate measure- 
ment of an individual’s perceptual be- 
havior will provide the basis for an 
evaluation of his personality organiza- 
tion. The assumption goes further in 
saying that certain perceptual behavior 
is normal for a hypothetical average 
person, and that the examinee’s emo- 
tional patterns and intellectual level of 
functioning will distort his perceptual 
behavior from this hypothetical aver- 
age in a systematic manner. It has 


* This study was supported in part by a grant 
from The Carnegie Foundation Research Pro- 


, gram of Tulane University. 
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been the procedure in the past to set up 
a perceptual task of one kind or another, 
observe the behavior of an individual 
who has certain subjectively evaluated 
emotional patterns and intellectual func- 
tioning level, and then to state that the 
resulting perceptual behavior is the pat- 
tern one will find in all individuals with 
such emotional patterns and level of 
intellectual functioning. 

The Bender-Gestalt test, which will 
be referred to from here on as the B-G 
test, was built on the premise that ac- 
curate visual-motor perceptual behavior 
is a skillful act. This skillful perceptual 
act is considered to involve (a) sensory 
reception, (b) central neural interpre- 
tation, and (c) motor reproduction 
(hand drawing) by the perceiving sub- 
ject of the test stimulus objects. The 
premise goes further and states that 
this total perceptual process can be dis- 
torted by neural injury, by variations 
in the intellectual level, and by malad- 
justments in the emotional organization 
of the perceiving subject. If the truth 
of this premise is assumed for the 
present, then the problems become (a) 
to evaluate quantitatively the amount 
of distortion in the figure reproduc- 
tions, (b) to discover the patterns that 
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the distortions take, and (c) to relate 
both (a) and (b) to the disturbances 
judged to be present in the subject's 
personality organization. 

To meet these problems is the pur- 
pose of this study. To that- end it is 
proposed : 


1. To develop an objective scoring 
method for the B-G test. 

2. To objectify by means of opera- 

tional definitions, as far as prac- 
ticable, the perceptually meaningful 
factors of the test. 
To give some measure of the test’s 
reliability and validity by (a) com- 
paring the test results of individuals 
judged emotionally neurotic with 
those judged emotionally normal, 
and by (b) comparing the test re- 
sults of individuals judged to have 
different types of neurotic emo- 
tional adjustment patterns. 


HistorIcAL BACKGROUND 


Related Tests. Perceiving of the type 
utilized in the B-G test was investigated 
by several workers with psychotics dur- 
ing the 1930's. Earlier interest had 
heen centered in the level of receptor 
thresholds in these patients, but when 
these were discovered to be about the 
same as for the normal individuals, this 
approach was discarded. Hunt (10) re- 
ports observations by Kraiz (1936) to 
the effect that schizophrenics see sta- 
tionary objects as if they were moving 
away from the eyes, and that the visual 
field could become so constricted or 
disorganized that the size, the spatial 
relations, and the consistency of objects 
are changed. Harrower(8) found a 
rigidity of set manifested in the figure- 
ground perception of patients with 
cerebral lesions not involving the occipi- 
tal lobes. Hunt(10) concludes a review 
of several authors with, “it appears 
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tentatively that the perceptual processes 
show the greater evidence of deficit 
over the receptive processes. Further- 
more, the deficit appears to reside in 
the central processes initiated by re- 
ceptor action, particularly in the re- 
sponse to patterns and in the alternation 
of sets or attitudes.” Thurstone(19) 
and his co-workers attempted to evalu- 
ate this problem of perceptual behavior 
versus fundamental dynamic character- 
istics of the individual by applying fac- 
tor analysis to the test scores from a 
large number of perceptual tasks ad- 
ministered to an adequate group of 
subjects. He found some factors, but 
his basic hypotheses were not substan- 
tiated due to the lack of significant in- 
tercorrelations between the tasks. 


The B-G Test. The B-G test consists 


of nine drawings selected from the 
thirty or more that Wertheimer(2!) in- 


cluded in his group upon which he es- 
tablished his first series of basic gestalt 
principles. These nine figures are copied 
with India ink on individual plain white 
cards. The subject is given a sheet of 
84%” x 11” plain white mimeograph 
paper with additional sheets easily 
available, plus a sharpened pencil that 
has an eraser. The present method calls 
for the cards to be presented by laying 
them’on the desk in front of the subject 
one at a time, and he is asked to copy 
them in any way he sees fit. There is 
no time limit. His behavior throughout 
the testing period is observed and re- 
corded inconspicuously. When the sub- 
ject has completed the drawings, the 
figure reproductions are evaluated for 
such perceptually meaningful factors as 
size, rotation of the drawing on the 
test paper, closure of the figures, man- 
ner of organizing the drawings on the 
page, the amount of paper required for 
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all of the drawings, the carefulness in 
his drawings, the tendency to repeat 
drawings or repeat his drawing strokes 
on one figure’s lines, the tendency to 
break the figures at unusual places, and 
the tendency to use figure parts that 
are used by people of a lower mental 
age than the subject's. From these fac- 
tors, linked with observations of the 
subject during the testing period, the 
examiner develops a limited personality 
sketch, covering such personality sali- 
ents as evidences of anxiety, regression 
in intellectual efficiency, compulsive or 
obsessive tendencies, perseverative be- 
havior, sexual adjustment, feelings of 
elation or euphoric tendencies, indica- 
tions of depression, confusion, and an 
estimation of emotional lability. This 
sketch is then to be linked with knowl- 
edge gained from other clinical data 
before a total personality picture is at- 
tempted. 

In the nine or more years of its exist- 
ence, the B-G test has not amassed an 
impressive bibliography. Aside from 
3ender’s own studies(3,4) only a few 
published accounts are available. Hutt 
(11) and the Psychology Staff(2) of the 
Mason General Hospital have presented 
manuals, whose nature and purpose 
precluded the use of statistical data. 
Orenstein and Schilder(13)administered 
the test figures to schizophrenic patients 
before and after insulin shock. They 
noted fewer destructions of the gestalt 
principles after shock than before. 
Stainbrook and Lowenbach(18) admin- 
istered the test figures during periods 
of post-convulsive reintegration, ob- 
taining repeated drawings, at various 
time intervals after the convulsion, 
from the same patient. They found that 
the earliest attempts at copying the 
figures resulted in reactions to the fig- 
ures as a whole, a simple loop separated 





in space being made for each obvious 
element of the test figure. In the re- 
covery sequence angularity was the next 
feature to be correctly represented, then 
the units of the figure were gradually 
brought into their proper spatial rela- 
tionships, and finally near the end of 
the recovery period the parts of the 
figure were represented joined together 
as in the test models. Wechsler(20) 
does not report a complete study, but 
states, “We have applied (Bender’s ) 
test to patients variously diagnosed as 
seniles, and found that the figures are 
reproduced by these patients as primi- 
tive loops or segments of large arcs, 
perseverated in a wavelike manner. 
This is precisely the same thing that 
Bender found to be characteristic of 
children’s efforts prior to the matura- 
tion of the psychomotor function 
(M.A. of 2 years), and in particular of 
mentally defective children of about 
this M.A. level.”’ 

Glueck(7) administered the test to a 
number of patients in an Italian hos- 
pital for psychotics and also to a group 
of judged emotionally normal indivi- 
duals. He was unable to discover any 
discriminating differences between the 
reproductions of the two groups, and 
concluded that the test was not useful 
except as a performance intelligence 
scale in children. Irion, Pascai and 
Hobbs(1, 9) report a study in which the 
B-G figures were administered, by the 
same technique employed in the present 
study, to 33 psychiatric patients who 
had been referred to an army psycho- 
logical clinic for special evaluation, and 
also to 23 enlisted assistant psycholo- 
gists in the clinic. The test records of 
these subjects were evaluated subjec- 
tively by 10 of the 23 enlisted psycholo- 
gists who had previously taken the test, 
and ranked by them as to the degree of 
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severity of emotional disturbance they 
thought was indicated by the test rec- 
ords. Reliability coefficients of .74 to 
.93 were obtained for the rankings of 
the judges. They found a mean rank 
of 35.9 for the psychiatric group: of 
patients and of 17.3 for the assistant 
psychologists, and concluded that the 
test highly discriminated the normal 
subject from the psychiatric patient. 
Rotter(1) wrote an evaluation of this 
study which is of interest. “‘Interpreta- 
tion of the results must take into ac- 
count that members of the control 
group were highly selected in terms of 
intelligence, had a general familiarity 
with psychological tests, were biased 
because of their participation in the 
study, and were motivated to do well. 
The superior caliber of their records 
may well have been due to one or more 
of these factors, rather than to a low 
degree of emotional disturbance. It is 
likely that motivation was a very im- 
portant factor in producing the group 
differences, since subjects with low 
motivation would tend to produce in- 
accurate and careless reproductions.” 


METHODS 


The Test Material. The Standard Card 
Test Figures employed by the author 
were one of one hundred sets made for 
a group of Army clinical psychologists 
working with Hutt, by an amateur me- 
chanical draftsman. These were pen 
and India ink drawings, placed on 
&” x 5” plain white index cards. In 
spite of the best efforts of the drafts- 
man, there are errors in these drawings. 
For example, the dot of the column of 
three dots in Figure 3 was omitted en- 
tirely (later added by the writer) ; 
parallel or related angled lines in Fig- 
ure 7 were of the same lengths in the 
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original figures, but were distorted in 
the Standard Cards; the original Fig- 
ure 6 is not rotated, but in the Standard 
Cards it has been rotated counterclock- 
wise almost: five degrees. There are 
some other minor discrepancies. 

The method of administration fol- 
lowed in this study is that indicated in 
Hutt’s Guide, though this experiment 
was started prior to the publishing of 
that document. The test materials in- 
cluded the standard card test figures, a 
quantity of 8%” x 11” white unruled 
paper of mimeographing stock, and a 
No. 2 pencil with an eraser. A hard, 
smooth top table or desk was available 
so that the subject’s reproductions were 
not governed by the irregularities of 
the surface underneath the test paper. 
The subject was seated to the exam- 
iner’s left in such fashion that continu- 
ous observation of his methods of 
work, comments, and behavior could be 
maintained without strained effort. 


Subjects. The test was administered to 
an experimental group of 100 Psycho- 
neurotic adult, male patients, all sol- 
diers in an Army hospital, and to a 
normal group of 50 adult male soldiers 
judged to fall within the normal range 


of emotional behavior. The subjects 
were selected at random, as nearly as 
possible, from the large number that 
passed through the writer’s hands. The 
judgments for the Experimental group 
were carried out by a group of four 
psychiatrists and the writer, employing 
data collected from personal interviews, 
medical and life histories, and a battery 
of tests including the Rorschach, the 
Wechsler-Bellevue Form I, the Minne- 
sota Multiphasic, and the Kuder Pref- 
erence Record. Additional tests were 
employed, but not uniformly from sub- 
ject to subject. The Normal subjects 
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gave no history of neuropathic traits, 
gave no civilian or Army history of 
crippling emotional disorders, and were 
in the process of being discharged at 
the time of taking the test. The two 
groups were of comparable age, intelli- 
gence, civilian and Army occupational 
experience, Army combat experience, 
and home town populations. 

None of the Experimental subjects 
had major organic injuries or defects, 
although 50 had records of injuries 
sustained either in combat or accidents 
some time during their Army careers. 
All were fully ambulatory. The six 
Psychoneurotic Post-traumatic Consti- 
tution subjects demonstrated a positive 
E.E.G. record at some point in their 
Army hospital records, and gave his- 
tories of combat shell-blast concussions. 
None of them, however, presented his- 
tories of dented, fractured, or open 
skulls in the brain areas. It cannot be 
stated with assurance that the positive 
E.E.G. records for these patients were 
the result of the concussion rather than 
due to some other condition existing 
prior to that injury, but their histories 
did not contain records of head injuries 
prior to their Army service. Finally, 
the neurological examinations of all of 
these subjects were negative. 

The diagnoses accepted for the Ex- 
perimental subjects of this study are 
not necessarily those that appear in 
their Army records. It was planned 
that all subjects selected should be 
diagnosed primarily as “Psychoneuro- 
sis,” and then should have a secondary 
or sub-diagnostic label that would more 
carefully group them within that pri- 
mary emotional pattern using formal 
definitions, with Adolph Meyer's teach- 
ings influencing any modifications that 
were introduced. 


The question arises as to whether a 
group with combat experience should 
have been used as subjects for this 
study since such experience has a tend- 
ency to disturb emotionally even the 
most stable person. Support for this 
point might be found in the fact that 
nineteen prospective subjects for the 
Normal group had to be discarded’ be- 
cause obvious neuropathic traits became 
evident during the clinical interview. 
This figure is almost one-third the total 
number tested. It should be pointed 
out, however, that none of these nine- 
teen subjects, according to their rec- 
ords, had allowed their neuropathic 
characteristics to interfere with their 
ability to perform efficiently in the 
Army. In spite of the negative feature 
of combat experience it appears to the 
writer that the final group of subjects 
is the most adequate that could have 
been selected as a control for the Ex- 
perimental group under the existing 
circumstances. The following are the 
reasons for this statement: 


1. It is extremely difficult to define 
what shall constitute normal emo- 
tional adjustment to a given envi- 
ronment. 
An estimate of the effect of combat 
experience on the index scores of 
the test is possible by a comparison 
of the index frequency distributions 
for those subjects of the Experi- 
mental group with combat experi- 
ence as against those of the same 
group without combat experience. 
5. The fact that such a large percent- 
age of both the Experimental and 
Normal subjects had combat ex- 
perience should tend to act as a con- 
trol for that variable. Therefore, 


bo 


if index differences appear between 
the two groups, the assumption that 
the differences are characteristic of 
more permanent personality pat- 
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terns rather than those brought 
about by temporary environmental 
stress is acceptable. Since we are 
dealing with psychoneurotic pat- 
terns, we should find many differ- 
entiating factors of a more ‘“‘perma- 
nent” nature. 

4+. The same type of professional peo- 
ple judged the adequacy of Army 
adjustment for the subjects of both 
groups. 


34 33 32 3/ 30 29 28 27 26 3 
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Objective Scoring Method. Considera- 
tion of the various scoring methods 
that might be used on the B-G test 
eliminated all but In this one, 
length of lines, areas of curves, and de- 
grees of angles were measured, and 
these measurements in turn combined 
into indices expressing various geo- 
metrical relationships. Such a method 
required the construction of a measur- 
ing device with three different scales, 
one each for lengths, areas, and angles. 
The scale shown in Figure 1 was de- 
veloped to meet these requirements. It 
has three sections including (a) a grid, 
(b) the center linear scale, and (c) 

protractor. Section a and b both em- 
ploy the metric system, the smallest 
unit representing one millimeter, and 


one. 
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the larger units representing five milli- 
meters. The units of the protractor sec- 
tion are placed at 5 degree intervals 
through an are of 180 degrees. Color- 
less, heavy gauge plexiglass gives the 
necessary transparency without warp- 
ing. The scale units were scratched in 
with a pointed steel tool, and later 
blackened with several applications of 
India ink. A small hole was drilled at 
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Illustration of the measurement scale and its units. 


the exact point where the protractor 
radii converged to permit the insertion 
of a pointed steel needle when this sec- 
tion of the scale was being used. This 
technique permitted the placement of 
this focal point at the desired spot on 
any angle of the test paper, and fur- 
ther permitted the movement of the 
scale around this point without losing 
the placement. Guide lines were drawn 
on the figure reproductions with a fine 
red pencil to assist in speeding up the 
measurements. 

Thirty-eight factors (Appendix En- 
try I) were defined objectively, and 
137 indices set up to measure them. 
The term “factor” is used here to refer 
to a certain rather clearly detectable 
test behavior observable in one or more 
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of the figures. Indices, on the other 
hand, involve the measurement on only 
one figure of such things as lengths of 
lines, angles, areas, irregularities in 
shape, and rotation of the whole figure 
or parts of the figure. Factors la, 2, 5, 
8, 14, 15, 19, 24, 26, 33, 34, and 37 are 
completely new. Factors 6 and 23 were 
not included by Hutt, but were con- 
sidered important by Bender. Factors 
3, 9, 12, 17, 20, 22, 25, 27, 30, 31, and 
32 either have not been defined in the 
available literature except for the list- 
ing of a name, or have been inade- 
quately defined with resulting confu- 
sion. Hutt’s factor, “Use of White 
Space,” has been omitted here on the 
grounds that the factor, ‘Page Cohe- 
sion,’ covers the concept as adequately 
as any objective definition of Space is 
capable of doing. Hutt’s Condensation 
and Simplification have also been 
omitted since he fails to define them or 
to give an example, and if they have 
the meaning suggested by Bender, they 
are simply synonymous with Regres- 
sion. Bender does not employ the term 
“Elongation” while Hutt uses it with- 
out definition. The writer’s definition 
is based purely on his judgment that 
the test behavior indicated in the defini- 
tion is what Hutt had in mind. 

Certain factors involving the ob- 
servations of the subject have been 
neglected, such as Anticipatory Be- 
havior, Blocking, Motor Incoordina- 
tions, and Relation to the Examiner. 
The writer anticipated, in planning the 
study, that Motor Incoordinations 
would be discernible from the draw- 
ings. In fact, he felt fairly secure in 
such an interpretation of the small 
waves that were produced in the linear 
lengths of 17 cases. There were many 
more cases, however, where the writer 
Was in possession of objective evidence 


of the presence of tremulousness in the 
patient’s hands, and yet he was unable 
to discern this in their drawings. This 
fact raised serious doubts as to the 
validity of his judgments in this par- 
ticular, forcing the technique to be dis- 
carded. Objective rating scales had not 
been prepared at the time this study was 
instigated for the three other observa- 
tional factors necessitating their exclu- 
sion. 

The Experimental records were 
scored for all indices and, therefore, all 
factors. The task required approxi- 
mately 15 hours for each of the 100 
records, a time period that prohibited 
the use of the method in a practical 
testing situation. The number of the 
indices was reduced, therefore, from 
137 to 63 and the number of factors 
from 38 to 25. The thirteen factors so 
excluded have been starred in the list. 
These general considerations were fol- 
lowed in the weighting processes em- 
ployed to accomplish this reduction. 


1. If the index showed a significant 

median difference between one sub- 

diagnostic category and one or more 
of the other categories, it was kept. 

If factor measurement need was a 

principle to be considered, and a 

choice of more than one index was 

available for that factor, the index 
that showed a median difference of 

1.0 or greater between one or more 

sub-diagnostic categories was given 

preference. 

3. Those indices correlating .60 or 
greater with other indices of the 
same figure were considered as a 
group, and preference given to those 
one or two that correlated most 


bo 


highly with the largest number of 
other indices but were not highly 
correlated with each other. 

+. Indices that correlated .20 or higher 








FRED Y. BILLINGSLEA 


with the Wechsler-Bellevue Full 
Scale score were given preference. 
Those factors with consistency cor- 
relations of .30 or greater were 
given preference in the selection of 
representative indices. 

Those indices with individual con- 
sistency correlations of .30 or 
greater were given preference. 


Five of the thirteen excluded factors 
1.e., Confabulation, Crossing Avoid- 
ance, Fragmentation, Ornamentation, 
and Perseveration, were omitted be- 
cause they were not represented in the 
Normal group records, and for all prac- 
tical purposes were absent from the Ex- 
perimental group records. The defini- 
tions of the 63 indices representing the 
final battery along with the factors to 
which they refer are included in the ap- 
pendix as Entry II. The test records 
for the 50 subjects of the Normal group 
were scored for these 63 indices only.’ 


RESULTS AND DISCUSSION 


The Objective Scoring Method. One 
condition which would appear to be a 
“must” in an objective scoring system 
for this test is a score on one or more 
indices of a figure that would indicate 
the destruction of the original gestalt 
design of that figure. Such a require- 
ment is more easily stated than met. 
The difficult problem is to decide what 
conditions shall be accepted as indica- 
tive of a destroyed gestalt. Bender and 
Hutt both use the concept, but fail to 
define the condition. In discussing her 
various test records, Bender states that 
a figure reproduction is not recognizable 
as the original gestalt, or that the basic 
gestalt pattern is present although 


1. To facilitate this process a work sheet or 
scoring sheet was developed. It provided en- 
tries for measurements and step by step calcula- 
tions. 


elaborated beyond recognition. In these 
statements she assumes that her readers 
will come to the same conclusion with- 
out her having to give reasons for 
reaching that conclusion. Hutt simply 
makes a statement about the destruc- 
tion of the gestalt quality and does not 
pursue the condition further. It was 
expected at the start of this study that 
extreme scores on certain of the indices 
for a particular figure could be utilized 
in combination form to define and like- 
wise to score for this condition. Only 
one subject in our samples distorted 
one figure sufficiently to make its rec- 
ognition questionable. Therefore, we 
were unable to set up critical scores and 
the question still remains unanswered. 
Another condition that became evi- 
dent upon the completion of the index 
calculations was the fact that Indices 
7A, 7B, and 8C will change consid- 
erably in their magnitude with a rela- 
tively small change in the size of the 
width of the figure. The reader will 
recall that these indices are a measure 
of the size of the figure using the 
length times width formula. What is 
more disturbing is the fact that the 
accuracy of the measurement method 
for width is inadequate compared with 
the demands of this formula. No way 
of reducing this dependence could be 
discovered, so the accuracy of the index 
rests upon following the exact measure- 
ment procedures. There is an interest- 
ing sidelight in this connection. The 
author and other trained psychologists, 
to whom he has shown certain figure 
reproductions, have experienced diffi- 
culty in subjectively evaluating with 
accuracy the relative size of the two 
subparts of Figure 7, when those two 
subparts are quite similar in size. That 
subpart which appeared to be the larger 
of the two often was actually the 








smaller. This situation needs to be 
subjected to further empirical evalu- 
ation. In general, the statistical data 
of the study permit the following con- 
clusions concerning the scoring method: 








1. The index scores differentiate the 
records of individuals. : 

2. The task of scoring the test records 
can be reduced to a routine clerical 
procedure. This is not true of in- 
terpretation, however. 

3. The index scores are a priori statis- 
tically reliable and may be used in 
any statistical procedure. 

4. The index scores can be readily in- 
terpreted as to the test behavior 
they represent. For example, a score 
of 1.2 on the index measuring the 
shape of the reproduced circle in 
Figure “a” indicates that the circle 
was stretched along its horizontal 
axis. A score of 1.0 on that index 
indicates that the circle was repro- 
duced with equal radii on both the 
horizontal and the vertical axes. 



















Reliability. The problem of determin- 
ing the reliability of any device pur- 
porting to measure the dynamics of 
personality organization is difficult to 
solve. If one considers employing the 
test-retest method, one has to consider 
not only memory from one test period 
to the next, but also the fact that the 
personality organization being meas- 

















TABLE 1. Consistency intercorrelations between those scores obtained by adding similar 
index scores of figures on one-half of the test and scores obtained by adding similar 
index scores of figures on the other half of the test 
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ured is fluctuating as to the salient em- 
phases being expressed. Thus, the two 
measured patterns of behavior might 
reasonably be expected to be different. 
Different forms of the test are not, at 
present, available. 

A third method was employed in- 
stead. It will be noted that several of 
the factors have measuring indices on 
more than one figure, i.e., size. It ap- 
peared statistically logical and possible, 
therefore, to utilize the split-half tech- 
nique. Such a correlation coefficient 
should indicate how consistently the in- 
dividual’s figure reproductions main- 
tain their relative characteristics from 
figure to figure. A low coefficient might 
mean that the test does not consistently 
bring out the individual’s manner of be- 
having on a certain factor, or it might 
mean that the factor in question does 
not represent a consistent personality 
reaction pattern of the individual. In 
any case, we could assume that predic- 
tions from test results whose consist- 
ency reliability coefficients are 
would have very doubtful accuracy. 

Tables 1 and 2 present reliability 
data. The correlations for Closure 


low 


(.50), Total Rotation (.61), and Size 
Differences (.62) found in Table 1 at- 
tract some interest. 


The coefficients in 

















Factor 


Measuring Indices* 















eat gess xia eins NN PEGI ooo 5 sss 'civned Ske esses 50 
2. Directional irregularity ..... DE eID oo sis es occ sec eneccs 25 
3. Part—Separation .......... INE io osc inc 5 Nike 0 6 ec cee pines 17 
4. Rotation—Part ............ BEE SO FU llrsg oie eccdectavarcccsaees —.24 
5. Rotation—Total ........... aM+1G+2H+3F+40 with 5SI+6N+7S+8M 61 
6. Shape Distortion ........... aB+3D+4B with 5C+7DD+7EE+H+8G ..... —.04 
7. Size differences ............ aP+1B+2I+31I+4R with 5L+6J+7M+8C  .62 














appendix. 


*For the definitions and explanations of these symbols, see Entries I and II of 
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TABLE 2. Consistency intercorrelations between individual index scores of the experi- 
mental group (N==100) purported to be perceptually meaningful for the same factor, 
but obtained from different figures 











Factor 
Number 





la. Angulation—Point: 


8J with 7U 
aaa 


Ib. Augulation—Slope: 


5H with 2E 
“ 6M 
“<9R 
6M “ 2E 


7R 
2. Circularity: 


aA with aB 
ate 
5C 


8. Directional Irregularity: 


1H with 2G 
ye ae 
a 
2G 
2) 
2K 
2L 
3G 
2J 
3E 
3E 
=: 
3G 
3G 


14. Left-Right Displacement: 


5] with 6L 
“8! 


Linear Regularity: 
3C with aD 
“ 4A 
oh: Pe 
ger) 


Number Distortion: 


1A with 3A 
o OK 


Indices 


Factor 


Number Indices 





22. Page Cohesion: 


9B with 6] 
ae 


Parallel Distortion: 


8H with 7V 
14S" 4 


Rotation—Part: 


aE with 4J 
yi ease | 


Rotation—T otal: 


aM with 1G 
a ee 

mt 

2H 

3F 

3F 

ak 


5] 

ON 
ON 
8M 


Separation of Parts: 
aG with 4L 
Shape Distortion: 


aB with 2E 
wade 
4G 
8G 
2E 
2F 
4G 
5C 
8G 
5C 
4G 
7T 
7W 
7DD 
7EE 














TABLE 2. 
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(Continued ) 














Factor 
Number 


Indices Number 






Factor 


Indices 





34. Shearing: 


- 
5K with 4C —.21 
“ 4D 07 





35. Size Differences: 





aP with 1B 
ae 


min 
So wm 








. 38 
re ae A5 
a aan 63 


21 ee .64 





I 6) 40 
7™M “ 8C 48 








Table 1 were obtained on added scores 


for indices from the first five figures as 
against those from similar indices of 
the last four figures. When we follow 
these same factors, however, through 
various relationships on an individual 
basis as in Table 2, the figure to figure 
consistency is less apparent. The other 
factors, except in one or two isolated 
instances show negligible consistency. 
We are forced to conclude, therefore, 
that the instrument is either unreliable 
as far as the factors measured are con- 
cerned, or that the factors measured 
are not consistently expressed by the 
individual with behavior patterns as 
judged. Bender was well aware of this 
characteristic of her technique since she 
says, “There is a tendency for the con- 
tinuous experimentation with the ex- 
ternal stimulating pattern and the ac- 
tion tendencies of the sensory-motor- 
conceptional person. The final pattern 
may represent a momentary point of 
equilibrium between the balancing func- 
tion, and is liable to change.’’(4, p. 5) 
Hutt suggests caution, but makes 
definite interpretative statements that, 
of necessity, assume consistency in this 
perceptual behavior of the individual. 


Validity. In the initial study, of which 
this paper constitutes the first report in 
length, the results from the Psychoneu- 





rotic and Normal groups were com- 
pared. Also, the Psychoneurotic group 
results were analyzed for differences 
between sub-diagnostic groups, for 
their indicativeness of such emotional 
characteristics as irritability, instability, 
depression, and sex disturbances, for 
the relationship existent between intel- 
ligence and test behavior, and for nor- 
mative test patterns other than the 
Standard Card Scores. In this paper 
we wish to present the validation results 
obtained by comparing the Normal 
with the Psychoneurotic record. The 
other findings will be reported at a 
later date. 

Table 3 presents the scores on the 63 
final indices that the Standard Stimulus 
Cards yield, the median scores from the 
figure reproductions of the Experi- 
mental ‘group and from the Normal 
group, and the critical ratios obtained 
when the medians of the two groups 
were contrasted. Certain statistical ex- 
planations are necessary. In all cases 
coded scores, 1.e., the raw scores trans- 
lated into coded step-intervals, are 
shown. Secondly, because of the man- 
ner of coding, indices aM, 7X, 81 and 
&J require corrections to bring the Ex- 
perimental and Normal group distribu- 
tions in equal relationships with each 
other. These corrections 


have been 
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TABLE 3. Medians and critical ratios on the final 63 indices for the experimental group 


(N=100) and for tlie normal group (N=50). 


Plus the standard card scores on these 


indices. 








Experimental 
Group Median 


Standard 
Card Scores 


Critical 


Ratio 


Normal 
Group Median 


Index 
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Group Median 
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4.13 
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* The coded scores for these indices should be equalized before comparing the two 
groups by subtracting the following amount from the score of the Normal group: 


a M -7 
7X -2 


given at the bottom of Table 3. Thirdly, 
the median was employed as the sta- 
tistic indicative of central tendency due 
to the presence, in many of the score 
distributions, of extreme scores that 
would disproportionately affect the 


8 I -2 
af 


mean. Under these circumstances the 
greater reliability of mean differences 
was sacrificed to the more realistic me- 
dian difference. Reliabilities of the me- 
dians were determined by the standard 
error formula with normality of the 
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distribution not assumed,” since the 
majority of our distributions contained 
a few very large and many very small 
or zero step-interval frequencies. It is 
recognized that Kelley(12) prefers 
smoothing such distributions near the 
median for greater accuracy, but such 
an additional step was felt unnecessary 
in this study, since the step interval in 
every case was only “1.” Finally, the 
Standard Stimulus Card scores are 
those obtained when the figures on the 
stimulus cards themselves were meas- 
ured and the results given their respec- 
tive code numbers. 

The first point of interest in Table 3 
is that there are only six indices, /.c., 
aH, 3D, 8J, 9D, 9G, and 9K with 
median difference critical ratios of 3.00 
and greater. Except for 9D (Regres- 
sion), and 9H (Erasures), these do not 
form a particularly interrelated pattern 
and certainly not a consistent one. Un- 
der the circumstances we shall be forced 
to be content with general trends and 
“better than guessing’’ interrelation- 
ships. The following generalizations 
have been developed from that orienta- 
tion =* 


Circularity: Clinical experience sug- 
gested that the tendency to distort 
the circularity of the circle in Figure 
‘a’ was characteristic of the Psycho- 

neurotic record. The hypothesis was 

put to test by using index aA. Table 

3 demonstrates that, on the whole, 


2. This formula reads: ¢Mdn==iVN where 


2F 
i equals the step interval, F equals the fre- 
quency on the step which contains the median, 
and N is the number of cases in the sample. 


3. In order to permit a more complete 
evaluatory discussion of some of the points in 
the material that follows, some statements will 
be based upon data not shown in the Tables. 
An attempt has been made to include at those 
points in the text the specific statistical material 
required, but in the interests of desirable brevity, 
the complete set of data has been omitted. 


it is the Normal group who distorts 
the circle more, and they do so by 
extending the circle’s horizontal axis 
relative to its vertical axis. The dif- 
ference in test behavior between the 
two groups is not sufficiently great 
to be significant, however. 


Closure: A strong general trend exists 
for higher Closure scores to appear 
in the Psychoneurotic records. This 
is significantly true of Figure ‘‘a.” 
Indices are aH, 7Z and &N. 


Left-Right Displacement: It appeared 
that in many Psychoneurotic records 
the subparts of Figures 5 (the 
handle), 6 (the vertical wavy line) 
and & (the small inner diamond) 
were either moved to the left or to 
the right of the point of contact with 
the larger component of the figure 
shown in the Standard Cards. The 
indices are 5], 6L, and 81. Although 
Table 2 indicates a definite reliability 
tendency, the factor does not differ- 
entiate between the Normal and Psy- 
choneurotic record. Even when criti- 
cal scores of high displacement were 
set up, the percentage of subjects 
arning these scores did not differ 
greatly in the two groups of subjects. . 


Linear Regularity: The tendency to 
make two lines unequal in length 
when the Standard Card called for 
them to be equal seemed to occur 
more often in the Psychoneurotic 
record. The indices are aD, 3C, 
(4A), (7E, 7F, 7G, 7H, 7T, 7W) 
and (8A, 8B, 8D). Evaluation 
shows, however, that the factor is 
unreliable, Table 2, and that it does 
not discriminate between the two 
groups of subjects on those indices 
where it was so evaluated, Table 3. 


Margins: There is a trend for the Nor- 
mal subjects to use margins more 
times in a single record. Index is 9C. 


Meticulous Carefulness: There is a sig- 
nificant tendency for this factor to 
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TABLE 4+. % of Records in the Two Groups Evidencing Total Figure Rotation 








Factor Indices 





2H 3F 40 





Psychoneurotic 
Normal 


46 44 38 


42 50 





occur a greater number of times in 
the Normal records, but the efficiency 
in reproducing the number of sub- 
parts of a figure is not increased 
thereby. Index is 9K. The correla- 
tion between Index 1A (number of 
subparts) and Index 9K is .10. 


Number Reproduction: The question 
often arose in using the test figures 
whether the neurotic individual does 
not tend to inaccurately reproduce 
the number of subparts of a figure 
relative to that called for by the 
Standard Card. This question can 
also be reoriented from the approach 
that the neurotic individual tends to 
be more rigid in his behavior and, 
therefore, more exactly reproduces 
the number of the subparts in the 
figures. The indices are 1A, 5A, and 
5B. From Table 3, the median dif- 
ferences between the two groups are 
too small for significance, although 
a slight trend exists for the neurotic’s 
record to show more errors. 


Page Cohesion: This factor, as a whole, 


is not discerning, but the trend exists 
for its low scores (1.e., all test figures 
crowded into a small part of one 
sheet of paper) to occur more often 
in the records of the Psychoneurotic 
group. The index is 9B. Frequency 
tabulations showed that 35% of the 
Psychoneurotic subjects earned a 
critical score of 1 or 2 on the index, 
while 18% of the Normal subjects 
earned this critical score. 


Logical or 


Irregular 
Orders are not discerning between 
the two groups even as trends; Con- 
fused Order may be found in the 


records of either group, although the 
frequency is low, 7% to 8%. The 
index is 9D. 


Regression: This test behavior is fre- 


quently present in the records of both 
groups, but the number of times it 
occurs in a single record is signif- 
icantly greater in those of the Psy- 
choneurotic subjects. The index is 
9p. 


Rotation: The following data have been 


abstracted from the frequency tables 
of the various indices measuring 
Total Rotation (Table 4). 

It is recognized that many of these 
subjects obtained scores that indi- 
cated rotations of the figures to only 
ten degrees in either direction. How- 
ever, rotation, as defined, includes 
any declination from the normal 
axis, and such test behavior has been 
considered perceptually meaningful 
by proponents of the test. It can be 
seen that Total Figure Rotation is 
frequently present in the records of 
both groups, but no significant dif- 
ference exists between the groups. 

In Part Rotation, the tendency is 
for the Psychoneurotic subjects to 
bring the two parts of Figures “a” 
and 4 closer together than that called 
for by the Standard Card score, while 
the Normal subjects tend to main- 
tain the Standard Card score rela- 
tionship. The indices are aE, and 4]. 

Reversal is the high degree or ex- 
treme rotation of parts in Figure 4, 
Index 4]. Frequency tabulations in- 
dicate that 5% of the Psychoneurotic 
records and 4% of the Normal rec- 
ords contained this test behavior. 
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Protocols of these subjects did not 
indicate the presence of disorienta- 
tion or dissociation. 


Shape: In general, there is an insuf- 
ficient difference between the records 
of the two groups of subjects to in- 
dicate even a trend. However, in- 
dices 3D and 8J are exceptions. In 
3D the Normal subjects tend to 
stretch Figure 3 unusually along its 
horizontal axis, which is not true of 
the Psychoneurotic subjects. In 8] 
the Psychoneurotic subjects tend to 
increase unusually the size of the 
angle on the left side of the large 
component of Figure 8, relative to 
the size of the similar angle on the 
right side of the figure. This is much 
less true of the Normal subject. The 
indices are aA, aC, aD, 2E, 3C, 3D, 
3H, 4D, 5C, 5J, 5K, 7U, 7X, 7DD, 
7EE, 8G, and 8]. 


Shearing: The hypothesis was estab- 
lished that the tendency to produce 
right or left shearing in the cup of 
Figure 5 relative to its base line is 
discerningly characteristic of the 
neurotic record. The index is 5K. 
Table 3 shows a median difference 
between the two groups of subjects 
that is not significant. It is interest- 
ing to note that the Normal records 
tend to show a leaning to the left 
relative to the Standard Cards, while 
the Neurotic records tend to lean to 
the right from Standard. It seems 
doubtful, however, that this trend 


would be substantiated with other 
groups of similar subjects. 


Sise: The trend is for the Psychoneu- 


rotic subjects to produce smaller fig- 
ures than the Normal group, espe- 
cially in the case of Figures 1, 2, 5, 
and 6. There is, however, noticeable 
reversal in the case of the size of the 
box of Figure 4. The indices are 
aN, aO, aP, 1A, 1B, 2Ba, 21, 3], 
4P, 40, 4R, 5L, 6Ea, 6Fa, 7A, 7B, 
7M, and &C. Frequency distributions 
for the two groups of subjects indi- 
cate that 30% and 23% of the Psy- 
choneurotic records earn low critical 
scores on indices 6Ea and 6Fa re- 
spectively, while 14% and 14% of 
the Normal group earned such scores. 
This simply means that the loops 
in both wavy lines of Figure 6 
were unusually reduced, “Curvature 
Values,” in a slightly greater per- 
centage of the Psychoneurotic rec- 
ords than in the Normal. 

A correlate of the question of the 
reproduction of size covers expan- 
sion, exaggeration, or unusual large- 
ness in the figure reproductions. 
Hutt contends that “some Psycho- 
neurotics and many Hebephrenics re- 
veal expansion.” This statement 
carries the inference that this test 
behavior is seldom, if ever, found 
in the test records of the Normal in- 
dividual. From the frequency dis- 
tributions of the Psychoneurotic and 
Normal groups we learn the follow- 
ing : 








Critical Coded 
Index Score 


Jo Psychoneurotic 
Group So Scored 


% Normal 
Group So Scored 





8 up 
11 up 
9 up 
12 up 
12 up 
10 up 
10 up 








16 


Sketching, 


Although we note that only a few 
Psychoneurotic records reveal this 
test characteristic, the interesting 
point is that it occurs to about the 
same degree in the Normal record. 

A second correlate of the question 
of the reproduction of size is found 
in the tendency to distort the relative 
size of the two subparts of Figure 7 
from that of the Standard Card. The 
index is 7K. We hypothesized that 
this was characteristic of the neurotic 
record. Table 3 shows that both 
groups of subjects tend to make the 
“X,” or right hand member of the 
pair, larger, and it is the Normal 
record that goes to the extreme in 
this characteristic. This finding sup- 
ports the first generalization made 
above, but serves to point up the 
need for norms other than the Stand- 
ard Cards. 


Erasures, and Re-starts: 
The intra-figure intercorrelations 
demonstrate a tendency for these 
factors to be interrelated: 1.e., in the 
Psychoneurotic group 9G with 9H 
has r = .43, 9G with 91 has r = .33, 
9H with 91 has r= .46. In other 
words, the Psychoneurotic records 
that have a large number of erasures, 
also tend to have a relatively larger 
number of re-starts, and to have a 
greater frequency of sketching. All 
three types of test behavior tend to 
be present in the records of the Psy- 
choneurotic subjects, and are present 
more frequently than in the records 
of the Normal subjects, except in 
the case of erasures. 


Verbal Resistance: A slightly higher 
percentage of the Psychoneurotic 
subjects were verbally resistant dur- 
ing the test, i.e., 21% Psychoneuro- 
tics versus 12% of the Normal sub- 
jects, but the difference is so small 
that it lacks significance. 


. . . ‘ . . 
Confabulation, Crossing Avoidance, 
Distortion of the Figure Beyond 
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Recognition, Fragmentation, Orna- 
mentation, and Perseveration: These 
six types of test behavior rarely oc- 
curred in the records of either group. 


When these results are compared 


with the pattern of test behavior for 
distinguishing the Psychoneurotic sub- 
ject as set forth by Hutt, definite dis- 
crepancies are quickly noted. The fol- 
lowing is a point for point examination 
of the two sets of results, employing 
Hutt’s list as the guide: 


a 


They agree in the non-occurrence 
of the Distortion of the figure 
beyond recognition. 

Contrary to Hutt, Total and Part 
Rotations occur frequently ir the 
records of both groups, but part 
Rotation in Figures ‘‘a” and 4 may 
have some diagnostic significatice. 

Contrary to Hutt, Regression oc- 
curs frequently in the records of 
both groups, but the number of 
instances it appears per record may 
be a discerning characteristic of 
the Psychoneurotic record. 

In agreement with Hutt, Persevera- 
tion and Fragmentation occur rarely 
if ever in either type of record. 

In agreement with Hutt, the Psy- 
choneurotic record tends to show re- 
duced size of the figures, especially 
Figures 1, 2, 5, and 6. This is also 
true of the Normal record, how- 
ever, but not, on the average, to as 
great a degree. 

In agreement with Hutt, the indices 
indicative of sexual disturbances 
are more frequently present in the 
Psychoneurotic records. 

In partial agreement with Hutt, low 
critical scores on the Size of the 
curves of Figure 6, “Curvature 
Values,” tend to be more character- 
istic of the Psychoneurotic record. 
This is not true of the high critical 
scores. 
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In disagreement with Hutt, Diffi- 
culty with Crossings is not present 
in the records of either group; it 
clearly is not distinctive of the Psy- 
choneurotic group in this sample. 
Hutt’s “Condensation and Simpli- 
fication” have been omitted since 
they are not defined or explained 
by example, and Bender’s use of 
the concept is the same as her Re- 
gression. 

In disagreement with Hutt, Rever- 
sal is not a distinctive test behavior 
in the records of the Psychoneurotic 
subject. 

In disagreement with Hutt, Sloping 
Angulation is not distinctive of the 
records of the Psychoneurotic sub- 
ject. 

In agreement with Hutt, Verbal Re- 
sistance is expressed more often by 
the Psychoneurotic subjects. 


The comparison of these two studies 
shows agreements in six particulars, 
i.e., the Psychoneurotic record tends to 
show reduction in the size of the fig- 
ures, the tendency to unusually de- 
crease the size of the loops of Figure 6, 
the tendency to include indices of sexual 
disturbances, the tendency to demon- 
strate verbal resistance to the test, the 
lack of complete destruction of the ges- 
talt of any of the figures, and the rarity 
of the appearance of Perseveration and 
Fragmentation. Most of the disagree- 
ments, however, rule out the discerning 
characteristics which Hutt employs. A 
few replacements are made, but the 
general conclusion from this sampling 
must support Bender* that a clear 
syndrome for distinguishing the Psy- 
choneurotic test record cannot be es- 
tablished. 


4. Hutt has stated to the author since the 
completion of this study that Bender has now 
reversed her point of view after observing some 
of Hutt’s reports. 


To disagree with Hutt’s conclusions 
does not settle the issues. One needs 
to search for possible inaccuracies in 
the present use of the test with the 
hope of improving the technique. Cer- 
tainly the experience of adequate clini- 
cians should not be in error to the ex- 
tent suggested by the results of this 
study. The writer feels that the fol 
lowing conclusions are justified . 


1. There is nothing in the above find- 
ings that detracts from the use of 
the instrument as a tool for intuitive 
observations of the client’s clinical 
behavior. However, with our pres- 
ent knowledge, it is not possible to 
establish a scoring system by which 
an insufficiently clinically trained 
person might utilize the instrument. 
Our knowledge of the perceptual 
process and its various “levels” of 
integration is woefully inadequate. 
If we are to continue to build pro- 
jective techniques, based on the as- 
sumption that emotional maladjust- 
ments express themselves in regres- 
sion to lower levels of perceptual 
integration, we need, then, to exert 
great research energy in examining 
this process. 

It is actually asking too much to 
expect an instrument to detect, with 
some degree of accuracy, a syn- 
drome of symptoms of whose defi- 
nition or delimitations we are un- 
certain. In place of attempting to 
detect Psychoneurosis as such, it 
would seem more appropriate to 
spend our time determining in what 
ways the instrument will detect such 
characteristics as the presence of 
anxiety, the degree to which the 
client is experiencing it, and his 
way of reacting to it, t.¢., constric- 
tion, the loss of control, and the 
like. 

The test should be modified in 
such fashion as to point out rigidity 
of set of the client, i.¢., a measure 
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of the ability to shift with ease 
from the requirements of one figure 
to those of another. This concept, 
of course, is included in the factor, 
Perseveration, but the suggested 
measurement in this test does not 
apply to the lesser degrees that are 
generally demonstrated by the 
minor disturbances. It is possible 
that the factor, Regression, holds 
the key to the solution of this prob- 
lem. We need, also, to examine 
the instrument for the effects of 
muscular tensions at the visual level, 
at the muscular coordination level, 
and then these two in combination. 
Finally, we need to develop objec- 
tive rating scales to accompany the 
test for the purpose of better or- 
ganizing our evaluations of the 
client’s behavior during the testing 
period. 
The method of administering the 
test needs to be standardized in 
keeping with our knowledge of 
gestalt principles. To do this en- 
tails: 
a. Accepting standard figures to be 
obtained from a central source. 
b. Correcting the irregularities in 
these figures such as replacing 
the liminal level of the grouping 
of the dots in Fig. 1, restoring 
the relative linear lengths in 
Figs. 7 and 8, establishing uni- 
form widths between parallel 
lines, establishing uniformity 
in the areas of the loops of Fig. 
6, and establishing uniformity 
in the related angles of the sev- 
eral figures. 
Remcve the figure numbers 
from the Standard Cards. 
Put the figures on heavier card- 
board stock for greater ease of 
administration and resistance to 
bending and creasing. 
Establish a standard hardness of 
the lead for the pencil, and the 


degree of sharpness of the point 
of the lead. 

Construct a framing stand for 
holding the stimulus card which 
will (1) place the stimulus fig- 
ures in an optimum position for 
the subject’s eyes, (2) estab- 
lish a constant frame for the 
stimulus figure, and (3) tend 
to reduce distortion of Shape 
and Size Constancy due to a 
poor retinal image. 

Provide optimal lighting and 
simplicity of testing room sur- 
roundings. . 
Determine at the end of the 
testing period what the client’s 
attitude was prior to coming 
into the testing situation and 
while he was reproducing the 
figures. 

The Standard Cards need to be re- 
placed as norms against which the 
client’s record is judged, by norms 
established on an adequate popula- 
tion sampling of individuals care- 
fully evaluated for the manner and 
degree of their emotional and intel- 
lectual adjustments. 

Improve the scoring procedure sug- 

gested here or substitute another 

more adequate method that has at 
least an equal degree of objectivity 
but a greater degree of simplicity. 

Two points in this connection are 

rather clear from the results of the 

present study: 

a. Though certain of the factors 
show a degree of inter-figure 
reliability, test behavior in the 
form of the present factors with 
indices in several of the figures 
is not valid. The possible ex- 
ception is Size Differences. In- 
dividual indices related to in- 
dividual figures, however, can 
be used as units of measure- 
ment and interpretation. 

When individual indices, repre- 
senting several different factors, 
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are combined, the combination 
often demonstrates a stronger 
trend towards validity than do 
the individual indices. 


SUMMARY AND CONCLUSIONS 


This study was conducted for the 
purpose of developing an objective 
scoring method for the Bender-Gestalt 
test, to operationally define the test fac- 
tors, and to utilize this method to ini- 
tially evaluate the test’s reliability and 
validity. To this end, 63 indices in- 
volving such things as the measure- 
ment of lengths of lines, angles, areas, 
irregularities in shape, and rotation of 
a whole figure or parts of a figure rela- 
tive to each other, were established to 
give quantifying coefficients to 25 test 
factors. This scoring method was ap- 
plied to the records of 100 judged psy- 
choneurotic male soldiers and to the 


records of 50 judged normal male sol- 


diers. The results from the two groups 
were statistically compared, and were 
also compared with the test factor syn- 
drome set forth by Hutt as distinctive 
of the Psychoneurotic record. 

From the results it was concluded : 


The instrument, in the hands of a 
trained clinician, is excellent for 
establishing rapport and observing 
the client’s behavior in a standard 
situation. 

Though three factors show a de- 
gree of inter-figure reliability, test 
Factors with indices from several 
of the figures tend to be unreliable 
and to lack validity. The exception 
is the factor of Size Differences. 
Hutt’s syndrome for the Psycho- 
neurotic record is not, in general, 
supported. 

Suggestions for improved stand- 
ardization and administration have 
been indicated. 
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1 
APPENDIX | 
Definitions of Factors 

Angulation: This term encom- 

passes two conditions where angu- 

larity is the important factor. 

a. Point Angulation (in Figures 

“a,” 4, 7, and 8): The per- 
ceptual reproduction of the de- 
gree of angularity existent be- 
tween two related angles in a 
figure’s linear outline; @.e., the 
degree of relationship between 
Angles 1 and 2 of the diamond 
of Figure “a,” the degree re- 
lationship between Angles “a” 
and “b” of the box of Figure 
4, the degree relationship be- 
tween Angles 3 and 6 of Fig- 
ure 8. 
Sloping Angulation (in Fig- 
ures 2, 5, 6 and 7): The per- 
ceptual reproduction of the de- 
viation of one or more sub- 
parts of a figure from the fig- 
ure’s basic horizontal or verti- 
cal axis; v.e., the upper left to 
lower right slope of columns 
of circles in Figure 2, the 
upper right to lower left slope 
of the handle in Figure 5, the 
upper right to lower left slope 
of the left hand subpart in 
Figure 7. 

Circularity (in Figure “a’’): The 

perceptual reproduction of the cir- 

cular form of the circle in Figure 

“a”; te., the ratio between the 

length of the horizontal. diameter 


to the length of the vertical diame- 
ter of the circle. 

Closure (in Figures “a,” 7, and 
8): The perceptual reproduction 
of the connected but not over- 
lapped linear joints in a figure or 
its subparts. 

Colliding: The colliding or cross- 
ing of one figure reproduction on 
the test results sheets with one or 
more other figure reproductions on 
the same sheet. 

Columnar Spacing (in Figure 2) : 
The perceptual reproduction of 
the distances existing between the 
columns of circles of Figure 2. 
Confabulation: The substitution 
of numbers, letters, or peculiarly 
shaped symbols for the correct 
subparts of a figure; the dots or 
circles of the figure may be substi- 
tuted, or the whole subpart or even 
the whole figure may be distorted 
into a peculiar shape so that its 


” 


original gestalt form is destroyed 


and unrecognizable. This factor 
is not the same as Ornamentation. 
Crossing Avoidance (Figure 6): 
The Fragmentation of the verti- 
cal or horizontal wavy lines, or of 
both wavy lines in such fashion 
that the two lines do not cross 
each other in Figure 6; the Left- 
Right Displacement of the verti- 
cal wavy line of Figure 6 to such 
a degree that it does not cross the 
horizontal line at any point. 

Directional Irregularity (Figures 
1, 2, and 3): The tendency of one 
or more members of a row of 
columns of a figure to diverge 
either to the right or to the left 
of that row or column with the 
result that the row or column 
is not straight; rather, it gives 
the appearance of “irregularity,” 
of “poor visual-motor control.” 
Sometimes this divergence is such 
as to bow or curve a line that is 
straight in the standard cards. 
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This factor may be related to, but 
cannot be said to be synonymous 
with motor incoordination. 
Elongation (Figures “a,” 7, and 
8) (See Shape Distortion). 
Erasure: The use of the pencil 
eraser of the test materials to 
eradicate a mark previously made 
in the figure reproductions. 
Exaggeration (Figure 6) : The in- 
crease in area of the loops of 
either one or both of the wavy 
lines in Figure 6. The term refers 
only to this characteristic in this 
figure. This factor is related to the 
size of Figure 6, 1.c., the length of 
the horizontal wavy line, but is 
not synonymous with Size Dif- 
ferences. 

Figure Order: The order in which 

the figure reproductions have been 

placed in the-test results sheet or 
sheets : 

1. Methodical; t.e., all figure re- 
productions follow each other 
in the direct or rigid sequence 
of “a,” 1, 2, 3, 4, 5, 6, 7, and 8. 
Orderly; 1.e., when 6 to 8 of 
the figure reproductions follow 
each other in direct sequence. 
Loose; 1.e., when 3 to 5 of the 
figure reproductions follow 
each other in direct sequence. 
Confused ; t.e., when no more 
than 2 of the figure reproduc- 
tions follow each other in di- 
rect sequence. 

Fragmentation (Figures “a,” 4, 6, 
7, and 8): The separation or divi- 
sion of the subparts of the figure 
in places usually not recognized by 
the gestalt principles; i.e., the 
breaking of usually solid lines into 
parts, the segmentation of a curve, 
the breaking up of a square into 
halves of a square in a way that is 
not Closure. 

Left-Right Displacement (Figures 

5, 6, and 8): The shifting of the 

point of connection between sub- 


parts of a figure either to the left 
or to the right; the point of con- 
nection between the handle and 
cup of Figure 5, the point of con- 
nection or crossing of the vertical 
and horizontal wavy lines in Fig- 
ure 6, the point of connection of 
the inside diamond to the top hori- 
zontal line of Figure 8. 

Linear Regularity (Figures ‘‘a,” 
3, 4, 7, and 8) : The perceptual re- 
production of the relationship be- 
tween the lengths of similar lines 
of a figure or its subparts; 7.e., the 
relation between the sides of the 
square in Figure ‘‘a,” the ratio of 
the left vertical side to the right 
vertical side of the box in Figure 
4, the ratio of the various similar 
sides in Figure 7, and the ratio of 
the various similar sides in Fig- 
ure 8. 

Lip Approximation (Figure 5): 
The bringing together of the lips 
of the cup of Figure 5 in such 
fashion as to tend to make, or 
actually make, a closed unit rather 
than the open cup. This is to be 
differentiated from Closure, al- 
though in the strict gestalt sense 
of the term, such behavior is true 
“Closure.” 

Margins: The creation of an iden- 
tifiable, consistent margin between 
the figure reproductions and the 
edge of the test results paper, this 
margin existing on either one, 
two, three, or all four sides of the 
paper. No identifiable margin is 
scored 1, a margin on one side of 
the test page is scored 2, on two 
sides is scored 3, on three sides 
is scored 4, and on four sides is 
scored 5. 

Meticulous Carefulness: The 
counting and checking of the 
count of the number of subparts 
of a figure on the standard cards; 
the attempt to use the pencil, 
fingers, or other devices in such 
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fashion as to give a closer ap- 
proximation of size or degree of 
angularity in a figure reproduc- 
tion; the slow careful drawing of 
lines, small circles, and dots in 
figure reproductions. 
Number Distortion (Figures 1, 2, 
3, 5, and 6): The perceptual re- 
production of the number of sub- 
parts of a figure as existent in the 
standard card scores. 
Ornamentation: The addition or 
embellishment of the figure re- 
productions with one or a number 
of unusual symbols, drawings, 
caricatures, and the like which, 
even though present, do not 
destroy the original gestalt organi- 
zation of the figure. 
Overlapping (Figure 7) : The per- 
ceptual reproduction of the degree 
and placement of the overlapping 
in the subparts of Figure 7 as 
existent in the standard card 
scores. Though related to Separa- 
tion of Parts, this factor is dif- 
ferentiated by its feature of over- 
lapping. 

Page Cohesion: The total amount 

of the test results page that all of 

the figure reproductions cover. 

1. Only one-third of one side of 
one sheet is used for all draw- 
ings. 

Only two-thirds of one side of 
one sheet is used for all draw- 
ings. 

Mere than two-thirds of one 
side of one sheet is used for all 
drawings. 

One and one-half sides of one 
or two sheets are used for all 
drawings. 

More than one and one-half 
sides of one or two sheets are 
used for all drawings. 

More than two full sides of 
paper are used for all draw- 
ings. 


23.* Pairing (Figure 1): The per- 


ceptual reproduction of the group- 
ing of the dots in Figure 1 into 
parts by placing two dots close to 
each other and at a greater dis- 
tance from their neighbors; 
whether the pairing starts with 
Dots 1 and 2 from the left side 
of the line of dots, or with Dots 2 
and 3 from the left side of the 
dot line is not essential. 

Parallel Distortion (Figures 4, 7, 
and 8): The compression of two 
parallel lines of a figure such that 
at one end of the lines they are 
closer to each other than they are 
at the other end; 1.e., the standard 
card scores call for parallelism in 
the box sides of Figure 4, in the 
long lines of the subparts of Fig- 
ure 7, in the long lines of Figure 
8, and compression of these at 
either of their ends would be con- 
sidered Parallel Distortion. 


* Perseveration: The repetition of a 


just previously employed figure 
reproduction as the figure repro- 
duction when a new stimulus card 
is presented. A definite distinction 
exists between this term and a 
high positive score for Number 
Distortion, though the behavior in 
the two situations is similar in 
psychological usage. 

Pointed Loops (Figure 6): The 
creation, in the figure reproduc- 
tions, of a point in the apex of 
one or more of the loops of the 
subparts of Figure 6. 

Regression: The reversion from 
the use of mature concepts in fig- 
ure reproductions (1.¢., concepts 
characteristic of the figure repro- 
ductions of an individual with 
average intelligence, normal emo- 
tional adjustment, and of the same 
chronological age as the subject) 
to the use of less mature concepts 
in figure reproductions (1.¢., con- 
cepts characteristic of the figure 
reproductions of an_ individual 
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with average intelligence, normal 
emotional adjustment, but of 
much younger chronological age 
than the subject). Such reversions 
may include: 

a. the use of circles instead of 


dots. 

b. the use of slashes instead of 
circles, dots, or continuous 
lines. 


c. the replacing of loops, circles, 
and dots by scribbles that have 
no clear individual perceptual 
organization, but in their 
grouping do form the standard 
gestalt figure. 

d. the use of ares instead of clear 
cut angles in the columns of 
Figure 3. 

Repeated Attempts at Reproduc- 
tion: The starting of figure repro- 
duction, either as part of a figure 
or as the whole figure, two or more 
times during the same testing pe- 
riod. 

Reversal (Figure 4): The rota- 

tion on its axis of either subpart, 

but not the total figure, of Figure 

4 such that the subpart is then in 

a fully reversed position from that 

existent in the standard card 

scores. This approximately 180- 

degree part-rotation is essentially 

possible only in Figure 4, a limita- 
tion separating Reversal from Ro- 
tation-Part. 

Rotation-Part (Figures “a,” 4. 

and 8): The revolving, at the 

point of their connection, of the 
subparts of a figure in either 

clockwise or counterclockwise di- 

rection such that the angle sub- 

tended between them is greater or 
less than that existent in the stand- 
ard card scores. 

Rotation Total (All Figures) : 

The revolving of the total figure 

on its axis in either clockwise or 

counterclockwise direction such 
that the angle subtended between 


ws 
i) 


w 
sa 


the figure’s horizontal axis and 
the horizontal edge of the test re- 
sults paper is greater or less than 
that existent in the standard card 
scores. 

Separation of Parts (Figures “a” 
and 4): The splitting of the figure 
into subparts at the point where a 
connection between the subparts 
is existent in the standard cards. 
This factor is related to closure, 
but is not to be considered synony- 
mous with it; it is this distinction 
which excludes Figure 8 from be- 
ing evaluated for this factor. 
Shape Distortion (Figures “‘a,”’ 3, 
4, 5, 7, and 8): The stretching of 
a figure along: its vertical axis 
relative to its horizontal axis, or 
the stretching of a figure along 
its horizontal axis relative to its 
vertical axis; the decreasing or in- 
creasing of the ratio of the length 
of a figure relative to its height. 
a. Elongation (Figures “a,” 7, 
and 8): Shape Distortion by 
stretching the figure along the 
horizontal axis only, resulting in 
an imcrease in the ratio of the 
length of a figure relative to its 
height. 

Shearing (Figure 5): The distor- 
tion, by shearing, of the cup of 
Figure 5 either to the left or to 
the right relative to its horizontal 
axis or base line; the tilting of the 
cup of Figure 5 to the left or to 
the right of the position as indi- 
cated in the standard card scores 
accompanied by a_ proportional 
distortion of the angles between 
the cup’s sides and the cup’s base 
line. This factor is not the same 
as Total Rotation. 

Sise Differences (All Figures) : 
The increase or decrease in linear 
or areal size of a figure from that 
existent in the standard card 
scores. In Figure 6 this is related 
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to, but does not include, Exag- 
geration. 


Sketching (Figures “‘a,” 4, 6, 7, | 


and 8): The use of repetitive 
strokes in forming the lines of a 
figure, i.e., three or more restrok- 
ings of one or more lines of a 
figure. This is to be differentiated 
from the draftsman or artist’s 
technique, which can usually be 
ascertained in doubtful cases by 
simple questioning: This is to be 
differentiated, also, from scrib- 
bling and the regressive use of 
dashes or slashes. 

Tailing Distortion (Figure 4): 
The perceptual reproduction of 
the proportionate amount of the 
curve in Figure 4+ that extends to 
the right and to the left of the 
points where the curve touches its 
base line; the increase or decrease 
in the ratio of the total length of 
the curve to that linear extent of 
the curve between the points where 
it touches the base line. 

Verbal Test Resistance: The num- 
ber of verbal statements made by 
the examinee at the beginning and 
during the test as complaints about 
the test and about the testing situ- 
ation. 


APPENDIX II 
Definitions of Indices 


A—Distortion of the circle as to 
whether the horizontal or the ver- 
tical axis is longer, with 1.0 
being perfect. Factor 2 


C—Distortion of the angles of the 
square; less than 1.0 means 
stretched out vertically, 1.0 is 
neutral, or perfect, greater than 
1.0 means stretched out horizon- 
tally. Factor la 


D—Distortion of the periphery of 
the square ; 0.0 is normal. 
Factor 15 


E—-Distortion of the axes of the 


square and circle as related to 
each other; 180 is normal. 
Factor 30 
H—Closure of the square and of 
the circle; 0 is normal closure; 1 
means overlapping but closed; 2 
is overlapping but not closed ; 3 is 
non-closure. The score represents 
the total of the weighted scores. 
Factor 3 
M—rThe rotation of the total fig- 
ure ; a minus score means counter- 
clockwise rotation; a O score is 
normal; and a plus score is clock- 
wise rotation. The size of the 
score gives the degree of rota- 
tion. Factor 31 
N—Size index, area in nature, of 
the circle. Factor 35 


O—Size index, area in nature, of 
the square. Factor 35 


P—Size index, area in nature, of 
the total figure. 


Factor 35 


A—Distortion in the number of 
dots used; 12 is standard. 

Factor 19 

3—Size in the average distance per 

dot; 2.15 is standard. Factor 35 


Ba—The average length of the 
columns of circles in Figure 2. 

Factor 35 

EK—Average slope of the columns ; 

65 is standard. Factor 1b 


I—Average space per column rela- 
tive to average height. Factor 35 


B—Distortion in the average dis- 
tance between the dots of the 
center line. Factor 35 

(—Distortion between line lengths 
of the upper and lower line of 
dots; less than 1.0 means longer 
lower line; 1.0 is standard; 
greater than 1.0 means longer 
upper line. Factor 15 


D—Distortion in the shape of the 
figure ; 2.31 is standard; less than 
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this figure means it is stretched 
vertically; greater than this 
means it is stretched horizontally. 
Factor 33 

H—Distortion in the maintenance 
of distance relationship between 
the center line dots; it is scored 
according to table with 9 being 
standard. Factor 35 


I—Size indices, in nature of area, 
of the figure; 25.5 is standard. 
Factor 35 


D—Distortion by compression or 
expansion of the vertical sides of 
the box relative to the horizontal 
side; 90 is standard; a_ lesser 
number means compression; a 
greater number means expansion. 

Factor la 


J—Distortion of the angular rela- 
tionship between the two parts 
of the figure ; 145 is standard. 

Factor 30 


O—Rotation of the figure; 0 is 
standard; a minus number means 
a counterclockwise rotation; a 
plus number means a clockwise 


rotation. Factor 31 
P—Size index, area in nature, of 
the box. Factor 35 


()—Size index, area in nature, of 
the curve. Factor 35 


R—Size index, area in nature, of 
the total figure. Factor 35 


A—Distortion in the number of 
dots used in the cup. Factor 19 


B—Distortion in the number of 
dots used in the handle. 
Factor 19 


(—Distortion in the relative height 
to the width of the cup; 0.7 is 
standard; a smaller number 
means horizontal stretching; a 
larger number means vertical 
stretching. Factor 33 

I—Rotation of the figure; 0 is 


N 


mn 


standard; a smaller number 
means counterclockwise rotation ; 
a larger figure means clockwise 
rotation. Factor 31 
J—Distortion of the horizontal 
point of connection of the handle 
to the cup; .29 is standard; a 
smaller number means the con- 
nection is closer to the cup’s right 
edge; a larger number means the 
connection is closer to the cup’s 
left edge. Factor 14 
K—Distortion in shearing of the 
cup’s sides relative to its base 
line; 1.0 is standard; a smaller 
number means the cup leans to 
the right; a greater number 
means the cup leans to the left. 
Factor 34 
L—Size, in the nature of area, of 
the figure; 22.4 is standard. 
Factor 35 





Ea—The average area of the loops 
of the horizontal wavy line in 
Figure 6 obtained by multiplying 
the length and height of each 
loop separately and then calcula- 
lating the average. Factor 11 

Fa—-The average area of the loops 
of the vertical wavy line in Fig- 
ure 6 obtained by multiplying the 
length and height of each loop 
separately and then calculating 
the average. Factor 11 


Ga—The regularity in the main- 
tenance of the same area from 
loop to loop in the horizontal 
wavy line. Factor 11 

Ha—The regularity in the main- 
tenance of the same area from 
loop to loop in the vertical wavy 


line. Factor 11 
J—Size, in length, of the horizontal 
figure. Factor 35 


A—Size, in the nature of area, of 
the figure X ; 13.13 is standard. 
Factor 35 
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B—Size, in the nature of area, of 
the figure Y ; 7.48 is standard. 
Factor 35 


C—Size, in the nature of area, of 
the overlap area; 6.6 is standard. 
Factor 21 


D—Size, in the nature of area by 
squares, of the overlap area; 35 
is standard. Factor 21 

K—Distortion in the relative size 
of X and Y: 1.12 is standard; a 
smaller number favors Y; a 
greater number favors X; 1.0 
means both are of equal size. 

Factor 35 

M-—Size, average of total figure, 
in area; 12.6 is standard. 

Factor 35 

U—Distortion in the relative angu- 
larity of the end angles of X; 
44 is standard; a smaller num- 
ber favors the obtuse angle; a 
greater number favors the acute 
angle. Factor la 

X—Distortion in X, the same as 
U; 4.6 is standard. Factor la 


Y—Distortion in Y, the same as 
U; 1.1 is standard. Factor 24 
Z—Closure within figures X and 
Y: scores are the same as for H 


m “a.” Factor 3 


DD—Distortion of the  length- 
width relation of X: 1.6 is 
standard; a smaller number fa- 
vors width; a greater number 
favors length. Factor 33a 


EE—Distortion same as DD for 
Y ; 1.6 is standard. Factor 33a 


(—Size of the figure in the nature 
of area; 44.24 is standard. 
Factor 35 


G—Distortion in the length-width 
relation of the large figure; 3.18 


is standard; a smaller number 
favors the width; a greater num- 
ber favors the length. Factor33a 
I—Distortion in the relative point 


of connection of the diamond 
with the top line of the large 
figure; .46 is standard; a smaller 
number favors the left direction 
of contact; a greater number fa- 
vors the right direction of con- 
tact. Factor 14 


J—Distortion in the relative size of 
the large figure’s acute end 
angles; .82 is standard; a smaller 
number favors the angle on the 
right end. Factor 1a 

N—Closure within the larger fig- 
ure and within the diamond; 
scores are the same as in H of 
figure ‘‘a.”’ Factor 3 

Factors of total test 

A. Order in which drawings are 

placed on sheets. Factor 12 


1. Methodical-Rigid, 1.¢., all 
drawings follow each other 
in direct sequence of a, 1, 
by Sg hy Oe Oe ts 
Orderly, i.e., when 6 to 8 of 
the drawings follow each 
other in direct sequence. 
Loose, i.e., when 3 to 5 of 
the drawings follow each 
other in direct sequence. 
Confused, t.e., when no 
more than 2 of the draw- 
ings follow each other in 
direct sequence. 

Page Cohesion Factor 22 
Only one-third of one page 
is used for all drawings. 
Only two-thirds of one page 
is used for all drawings. 
Only three-thirds of one 
page is used for all draw- 
ings. 

One and one-half pages are 
used for all drawings; can 
be either on front and back 
of same sheet, or on two 
sheets of paper. 

Two pages are used for all 
drawings; can be same 
sheet, back and front, or 
two sheets of paper. 
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Aa 


l 6. More than two pages are completion of the test.) 
2 B used for all drawings. Especially prominent for 
r C. Margin Factor 17° long strokes in Card 7 and 
1 § 1. No identifiable consistent 8. Score is the number of 
margin between edge of figures where this was 
: page and drawings main- done; possible score 3. 
-— tained. H. Erasures Factor 10 
; a 2. Identifiable margin main- 1. Number of drawings where 
| tained on one side of the the erasure was used to 
/ @ page, for example, left side. make corrections; possible 
. G 3. Identifiable margin main- score 9. (A large number 
. & tained on two sides, @e., of erasures in drawing one 
4 top and left. figure should’ be noted. 
4 4. Identifiable margin main- This is not given extra 
3 tained on three sides. scoring, however. ) 
; me a gi ee 1. Repeated attempts to copy the 
; = on four sic pt ‘ figures Factor 28 
q D. Regression Factor 2/ 1. Number of drawings where 


1. Circles used instead of more than one attempt was 
dots; score equals _ total made in copying a figure. 
number of drawings where Score is’ the number of 
this was done; possible drawings where this was 
score of 3. done. (More than two pre- 

2. Slashes, te, /////// liminary attempts to copy a 
used instead of circles, dots, simple drawing should be 
or continuous lines; score noted, but are not scored 
equals total number of extra.) Possible score 9. 
drawings where this was 
done; possible score of 9. 
Care should be taken so as 
as not to mistake artistic 
sketching for this behavior. 

3. Curves, circles, loops, and 
dots replaced by scribbles, 
and have no clear perceptual 
organization; score equals 
total number of drawings 
where this was done; pos- 
sible score 6. 


J. Resistance to the test Factor 38 
1. Number of verbal state- 
ments made by the examinee 
at the beginning and during 
the test proper. Score is 
this simple counted num- 
ber. (Subjective factors in 
this score are recognized, 
but its usefulness seems to 
warrant its inclusion in 
spite of this drawback. ) 


4. Ares used instead of clear- K. Counting and Checking 
cut angles; score equals Factor 18 
number of times this was 1. Examinee uses his _ pencil, 


® 
* 
o 


done; possible score /. 
Total score = a+b+ce+d 
tching Factor 36 
Use of repetitive strokes in 
making a figure. (To be 
differentiated from the 
artist’s technique which can 
usually be ascertained by 
simple questioning at the 


finger, verbally counts, or 
carries on other clearly evi- 
dent motor behavior in 
counting the number of 
dots, circles, or curves. 
Score is the number of 
drawings where this be- 
havior was carried on; pos- 
sible score is 5. 
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INTRODUCTION 


The primary purpose of the starva- 
tion-rehabilitation experiment carried 
out at the Laboratory of Physiological 
Hygiene, University of Minnesota, was 
to investigate under strictly controlled 
conditions the relative effectiveness of 
different types of diets in bringing 
about recovery from prolonged inani- 
tion. The starvation which preceded 
rehabilitation provided a unique oppor- 
tunity for the assessment of the physi- 
ological and psychological concomitants 
and effects of severe undernutrition. In 
accordance with the interdisciplinary 
character of research at the Laboratory 


(3), the methods and techniques of 


physiology, biochemistry, medicine, 
psychology, and psychiatry were em- 
ployed in parallel. Preliminary findings 
were reported for the use of research 
workers and Allied governmental and 


* The facts upon which this article is based 
were obtained in the course of a research project 
supported from various sources. From the out- 
set, sponsorship was provided by: The Brethren 
Service Committee, the American Friends Serv- 
ice Committee, the Unitarian Service Committee, 
the Mennonite Central Committee, the Sugar 
Research Foundation, New York, the National 
Dairy Council operating on behalf of the Amer- 
ican Dairy Association, and the John and Mary 
R. Markle Foundation, New York. Beginning 
July 1, 1945, the work was supported in part 
under a contract, recommended by the Committee 
on Medical Research, between the University 
of Minnesota and the Office of Scientific Re- 
search and Development. On November 1, 1945, 
the responsibility for this contract was assumed 
by the Office of the Surgeon General, U. S. 
Army. 

+ Present address: Division of Education and 
Applied Psychology, Purdue University. 

t Department of Psychiatry, University of 
Minnesota. 


military authorities concerned with the 
problems of nutritional rehabilitation 
(8,9, 10), and the salient aspects were 
briefly summarized for general use(7). 
Numerous journalistic reports, some of 
relatively high quality, have appeared 
(16). A general summary, prepared 
specifically for relief workers, has been 
published(6). The present paper is a 
detailed descriptive report on behavior 
in the Minnesota Experiment. 


EXPERIMENTAL DESIGN 


Thirty-six “normal” young men be- 
tween the ages of 20 and 33 (mean age 
25.5 years, S. D. 3.5 years) served as 
volunteer subjects. The body build, 
physical performance capacity, and per- 
sonality of these men varied within 
broad limits. 

Excluding the follow-up studies, the 
experiment lasted for approximately a 
year. Control data were obtained dur- 
ing three months of standardization 
(November, 1944 to February, 1945) 
in which the subjects were maintained 
on a “good” diet providing a daily aver- 
age of 3,492 Calories per man. Six 
months of semistarvation followed 
(February to July, 1945) when the 
actual daily average intake was reduced 
to 1,570 Calories. The diet was planned 
to simulate in quality and quantity the 
food available in western and central 
Europe under the conditions of severe 
food shortages during the Second 
World War. The semistarvation period 
was followed by three months of con- 
trolled rehabilitation ending in Octo- 
ber, 1945. As we are concerned in this 











HUMAN 








paper primarily with the descriptive, 
“qualitative” aspects of behavior, there 
is no need to go into the details of the 
complex design of the rehabilitation 
phase of the experiment(2). 


RESULTS: SEMISTARVATION PHASE 


Physical Changes and Energy Output. 
Striking changes occurred in the size 
and weight of the subjects, the average 
loss of gross body weight at the end of 
semistarvation representing twenty- 
four per cent of the control value. 
Both the face and the body showed a 
marked emaciation. Gradual wasting 
of muscle and subcutaneous adipose 
tissues made sitting on hard surfaces 
increasingly uncomfortable and some- 
times painful. For the same reason 
shoes were too large and clothes loose 
and poorly fitting. By the twelfth week 
of semistarvation, edema became com- 
mon and was especially noticeable in the 
knees, ankles, and face. The subjects 
reported that their nails grew more 
slowly and that their hair was falling 
out in large amounts. Shaving became 
necessary less frequently. The men 
noted, particularly in shaving, that cuts 
and wounds bled less than normally and 
were slower to heal. Physical ability to 
laugh heartily, sneeze, and blush was 
reduced or absent during the later 
stages of semistarvation. Muscle 
cramps and muscle soreness were re- 
ported. Jarring of knee joints,. espe- 
cially when walking on hard pavements, 
was an annoyance to some. Pigmenta- 
tion, thinning, and roughening of the 
skin occurred; however, changes in the 
sensitivity of the skin, paresthesic and 
hypesthesic in character, were observed 
only rarely. There were many com- 
plaints that the extremities “went to 
sleep.” Tolerance to heat was greatly 
increased, e.g. subjects could hold ex- 
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tremely hot plates without discomfort ; 
and they required their food, coffee, 
and tea served unusually hot. Con- 
versely, cold temperatures were poorly 
tolerated. Complaints of being cold or 
of having cold hands and feet were 
frequent and persistent. In hot sum- 
mer weather many of the subjects slept 
under heavy blankets and wore “extra” 
clothing during the day. Vertigo, gid- 
diness, and momentary blackouts were 
experienced On rising from lying or 
sitting positions by almost all during 
the first months and by some subjects 
throughout the semistarvation period. 
Actual fainting, however, occurred on 
only one occasion. Polyuria and, par- 
ticularly, nocturia became a common 
problem. 

Objective tests revealed no impair- 
ment of visual acuity, but many sub- 
jects complained of transient visual dis- 
turbances such as inability to focus, 
eye aches, and “spots’’ before their eyes. 
Standard measurements of hearing 
showed a slight but consistent increase 
in auditory acuity during the period of 
semistarvation. It is difficult to deter- 
mine whether the complaints, that ordi- 
nary sounds and noises were disturbing 
and annoying, had a direct physiological 
basis in the “improved” auditory sensi- 
tivity or were primarily signs of gen- 
eral increase in the irritability of the 
subjects. Sensations of fullness and 
ringing were reported by some. Exeept 
for hunger pains and some decrease in 
the frequency of bowel movements, 
gastro-intestinal symptoms were rare. 
In several cases periods of transient 
nausea were experienced. 

A marked decrease in pulse rate and 
in basal metabolism may be regarded 
as critical indicators of bodily adjust- 
ment to reduced food intake, involving 
a lowering of the speed of the auto- 
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nomic functions of the body. The overt 
movements also became noticeably 
slower, and voluntary energy output 
was in general markedly reduced. How- 
ever, overall energy expenditure was 
maintained on a relatively high level by 
scheduled physical activity (walking to 
and from the mess hall, hiking about 
twenty miles per week, etc.) in order to 
simulate conditions of natural starva- 
tion. 

The attitude of the men to physical 
exertion was ambivalent. It made them 
tired and as a rule was avoided. On 
the other hand, occasionally some men 
exercised deliberately. Thus certain 
subjects attempted to lose weight by 
driving themselves through periods of 
excessive expenditure of energy with 
the object of either obtaining increased 
bread rations (when weight loss ex- 
ceeded the prescribed rate) or avoiding 
reduction in rations (when weight loss 


lagged). Fatigue, weakness, and hunger 


were outstanding complaints. The 
marked reduction in strength and en- 
durance was paralleled by a curtailment 
of spontaneous activity. The subjects 
moved slowly and cautiously; they 
climbed stairs one at a time. Coordina- 
tion was affected, and the men some- 
times tripped over curbstones and 
bumped into objects which they in- 
tended to sidestep. 

In general, fewer and fewer things 
were capable of stimulating overt ac- 
tion. The subjects described their in- 
creasing weakness, loss of ambition, 
narrowing of interests, depression, ir- 
ritability, and loss of libido as a pat- 
tern of experience characteristic of 
“growing old.”” Even though a defined 
amount of physical work (principally 
walking) was required by the experi- 
mental regimen, fluctuations in spon- 
taneous activity accounted for large 


variations in daily energy output. All 
had periods of well-being when they 
expended much energy in working, 
exercise, and occasionally even in 
sports. 

The subjects were not apprehensive 
about their health. None evidenced 
anxiety over the possibility of chronic 
or permanent effects of the stress. They 
were confident that they would not only 
receive prompt and adequate care if 
they became ill but also that they would 
be removed from the experiment if se- 
rious consequences were thought likely 
to develop from their continued par- 
ticipation in it. 


Hunger and Appetite. In speaking of 
“hunger” the subjects referred to sen- 
sations vaguely localized in the abdomi- 
nal region which varied from mild dis- 
comfort to intense pain. In total starva- 
tion the sensation of hunger rapidly 
disappears. This is not true in semi- 
starvation. There was no diminution 
of the desire for food as the starvation 
progressed. While some subjects suf- 
fered relatively little from the distress 
of hunger, others complained of being 
hungry all of the time. Frequently the 
men complained of hunger immediately 
after eating a bulky meal. The most 
bulky was the most popular menu of 
the three to which the men were lim- 
ited.* The desire for variety in diet 

* The chief items on the three menus (repeated 
in rotation) were as follows: 

Menu No. 1. Morning meal—farina, fried po- 
tatoes, jello, bread, jam, milk, sugar. Evening 
meal—fish chowder, spaghetti, meat ball, pota- 
toes, peas and carrots, cabbage salad. 

Menu No. 2. Morning meal—oatmeal, pota- 
toes, gingerbread, bread, jam, milk, sugar. Eve- 
ning meal—bean and pea soup, macaroni, cheese, 
rutabagas, potatoes, lettuce salad. 

Menu No. 3. Morning meal—pancake, syrup, 
applesauce, corn bread, bread, jam. Evening 
meal—potato soup, stew, potatoes. 


It should be noted that such items as milk and 
meat were served only in token amounts. 
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became very strong at times but was 
always subordinated to the craving for 
greater quantity. 


Eating Habits. Anticipation of eating 
heightened the craving for food. Con- 
sequently, the men dreaded waiting in 
line while their meals were measured 
and weighed, cach man defensively 
guarding his place in line. They tended 
to become irritated when the serving 
was slow or those who served the food 
gave any evidence of not taking their 
business ‘‘seriously.”” The food had to 
be very hot to be satisfying. This was 
universally held to be very important. 
It was as though the starving individual 
“borrowed” heat from the food in- 
gested as a means of conserving energy. 

The subjects exhibited a possessive 
attitude toward their food. At the table 
some hovered closely over their trays 
with their arms placed so as to protect 


their ration. In eating they were, for 
the most part, silent, deliberate, and 
gave total attention to the food and its 
consumption. Many ingenious devices 
were used for making food appear to 
go further and to provide the illusion 


of variety. As the starvation pro- 
gressed, the number of men who 
“toyed” with their food increased. 
They made what under normal condi- 
tions would be weird and distasteful 
concoctions. There was a marked in- 
crease in the use of spices and salt. 
The subjects were often caught be- 
tween conflicting desires to gulp food 
down ravenously or to consume it 
slowly so that the taste and odor of 
each morsel would be fully appreciated. 
Toward the end of starvation some of 
the men would dawdle for almost two 
hours over a meal which previously 
they would have consumed in a matter 
of minutes. 


In order to maximize the pleasure of 
eating, there was much planning done 
by the men as to how they would handle 
their day’s allotment of food. Since 
the subjecfs went to the dining room 
only twice a day during the starvation 
phase of the experiment, many of them 
saved out part of their meals for later 
consumption. All food was consumed 
to the last crumb. The men were cul- 
tured and refined, yet they routinely 
licked their dishes in order to obtain 
every vestige of food. They quickly 
became intolerant of food waste and 
were visibly upset when they noticed 
others discarding food. There were 
many bitter comments that any spoilage 
or wastage of food was prodigal and 
criminal in a starving world. 

Individual food dislikes for such diet 
items as rutabagas and fish disappeared 
in the early part of the semistarvation 
period. Although the subjects were re- 
stricted to three rather monotonous 
menus, the taste appeal of the diet in- 
creased rather than diminished through- 
out the six months of semistarvation. 


Substitution Habits. Various 
techniques were developed to approxi- 
mate or substitute for satisfactions nor- 
mally derived from eating. Prominent 
among these were gum chewing and 
smoking. It was often reported that 
vivid vicarious pleasure was derived 
from watching other persons eat or 
from just smelling food. Large quanti- 
ties of water were consumed with and 
between meals, and the subjects in- 
creased the bulk of their food by “soup- 
ing.” For example, a man would drink 
the fluid from his soup, then fill the 
bowl with hot water, salt it heavily, drink 
the fluid off again, and repeat this 
process before eating the solid: part of 
the soup. Satisfaction was also obtained 
from consumption of coffee and tea 


Food 
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(without cream or sugar but with a 
limited amount of saccharin), both of 
which were used in large quantities, 
presumably for their pharmacological 
as well as their filling and warming 
effects. It was generally reported that 
coffee and tea provided a “lift.” Be- 
cause some of the men increased their 
consumption to fifteen or more cups 
daily, it became necessary to limit all 
subjects to a maximum of pine cups 
per day. A few occasionally violated 
the spirit of this restriction by brewing 
nine cups of the strongest possible tea 
or coffee and then diluting further with 
hot water. About a half dozen subjects 
who never drank coffee or tea before 
the experiment became habitual users 
of both. For experimental purposes, 
the subjects were occasionally placed 
for three-day periods on severely re- 
duced fluid intake; when thus deprived 
of their beverages, a few complained 
of headache and greater-than-usual las- 
situde. 

During the early part of the experi- 
ment the use of chewing-gum was not 
limited; however, in time this became 
excessive. “Heavy gum chewers’’ would 
take two or three sticks at a time, chew 
until the sweet taste was gone, discard 
them, and then replace with fresh sticks 
in chain fashion. Finally, some chewed 
up to forty packages of gum per day. 


One of the subjects chewed so con- ° 


tinuously that he developed a_ sore 
mouth. Thereafter, the use of gum was 
restricted to two packages a day. Sev- 
eral men who had not used tobacco 
prior to participation in the experiment 
acquired the habit of smoking during 


semistarvation because it afforded some , 


degree of relief from hunger. 


Preoccupation with Food. Food in all 


of its ramifications became the principal 


topic of the subjects’ conversations, 
reading, and day dreams. More dreams 
about food were reported as the stress 
continued. When subjects read books 
and attended movies, they were deeply 
impressed by the frequency with which 
food and eating were mentioned. Cook 
hooks, menus, and information bulle- 
tins on food production became in- 
tensely interesting reading matter to 
many of the subjects who previously 
had little or no interest in dietetics or 
agriculture. Some men went so far as 
to re-plan their lives according to their 
newly-acquired respect for food. For 
example, one man became impressed by 
the importance of developing efficient 
methods of food raising and decided to 
go into agriculture as a vocation. A 
few planned to become cooks. In some 
men there appeared, particularly toward 
the end of the experiment, a reaction 
against this “tyranny” of food; they 
became annoyed by discussions of food 
and related subjects. One man _ ex- 
pressed disgust at this ‘‘animal atti- 
tude ;”” another referred to such en-- 
grossment as “nutritional masturba- 
tion.” 


Adherence to Diet. The subjects were 
thoroughly aware of the importance of 
the experiment, and each man felt that 
his participation in the experimental 
program would result in a definite con- 
tribution to the body of scientific 
knowledge in an important area. They 
were convinced that the findings would 
aid in the relief and rehabilitation of 
the starving people of the world. Many 
of the subjects hoped to be able to go 
to Europe as members of nutritional 
relief teams, and they felt that they 
would be much more able to understand 
and to minister to famine sufferers by 


virtue of their first-hand starvation 
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experiences. These factors provided 
strong incentives to adhere strictly to 
the diet. 

Although some temptation to break 
the diet was present at times, voluntary 
commitment to complete the experiment 
as planned was, with few exceptions, 
_ greater than the tantalizing craving for 
food. This is attested by attainment of 
the required weight loss (an average of 
twenty-four per cent). Some men 
maintained that eating other food than 
that provided by the diet simply never 
occurred to them. Direct or indirect 
evidence of non-adherence to diet was 
obtained in four out of thirty-six sub- 
jects; these men were released from the 
experiment. 

In the beginning of the semistarva- 
tion period the subjects were allowed to 
go about alone but later were required 
to be accompanied always by a “buddy.” 
If invited out or to a friend’s home for 
a meal, a subject could take a part of his 
own food (likely a cold maraconi sand- 
wich or a plain slice of bread). Under 
such conditions the men disclaimed any 
conscious temptations and even re- 
ported annoyance when hosts or others 
tried to persuade them to take just a 
little extra food. 

The use of subjects on food-handling 
jobs was discontinued at their request 
because the temptations under these cir- 
cumstances became too great; they had 
found themselves inadvertently licking 
gravy off their fingers or picking up 
crumbs. 


Emotions and Attitudes. The cumu- 
lative effects of the stress were definitely 
associated with emotional instability. 
The men experienced transitory and 
sometimes protracted periods of depres- 
sion. They became discouraged because 
of their relative ineffectiveness in daily 


living. Inability to sustain mental or 
physical effort contributed much to this 
feeling of inefficiency. The persistent 
clamor of hunger distracted the sub- 
jects when they attempted to continue 
their cultural interests, hobby activities, 
and studies. The discrepancy between 
what the men wanted to do and what 
they were able to do resulted in frus- 
tration. 

During the advanced stages of semi- 
starvation there was a marked lowering 
of the threshold to depressive reactions. 
Although clinically, depression reached 
frankly pathological proportions only 
on rare occasions and in only a few in- 
dividuals, the men were always more 
serious and obviously less happy than 
during the control period. Unexpected 
spells of elation, sometimes bordering 
on ecstasy, occurred. Feeling “high” 
was sometimes attributed by the men to 
a “quickening” effect of starvation or 
to. success in adjusting to the semi- 
starvation diet. Feelings of well-being 
and exhilaration lasted from a few 
hours to several days but were inevi- 
tably followed by ensuing “low” pe- 
riods. Just as the subjects were unduly 
depressed by untoward events, their 
spirits were markedly boosted by such 
things as fine weather, anticipation of 
an outing, a profitable ‘bull session,” 
and other variations in daily routine 
capable of arousing enough interest or 
enthusiasm to take them ‘out’ of them- 
selves. 

Frequently, both subjects and ob- 
servers remarked that the group was 
apathetic. Apathy grew out of repeated 
failure, with accompanying frustra- 
tions, to carry on “normally” during 
the stress. Things which would arouse 
their interest tended more and more to 
fall within the complex of “guinea-pig” 
life; loss of body weight, hunger, and 
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food. In discussing these, the men 
would often become animated. 

The smooth-temperedness, patience, 
and tolerance evidenced during the con 
trol period gave way under stress to the 
converse. Irritability increased to the 
point where it became an individual and 
group problem. Although the men 
were aware of their hyper-irritability, 
they were not altogether able to control 
their emotionally charged responses. 
Thus, outbursts of temper and periods 
of sulking and pique were not uncom- 
mon, and a few had strong urges to 
violence but these were not carried out. 

The men exhibiting a large degree of 
personal and social deterioration easily 
became objects of aggression for the 
rest of the group. In particular, one of 
these subjects, who dramatized himself 
and his semistarvation role, served as 
a scapegoat and a ready reference point 
for favorable self-comparison. The 
men rated themselves in comparison 
with their normal condition as lacking 
in self-discipline and self control, sub- 
ject to indecisiveness, restless, sensitive 
to noise, unable to concentrate, and 
markedly “nervous.” 


It is likely that the widespread use of 


coffee, tea, and chewing gum repre- 
sented attempts to allay nervous tension 
hesides serving as substitutes for food. 
Similarly, the occurrence of nail-biting 
(not present during standardization) 
and the acquisition of or increase in 
smoking habits were related to in- 
creased ‘‘nervousness.”’ Personal ap- 
pearance and care began to deteriorate 
as the stress progressed. The men often 
neglected to shave, brush their teeth, 
and comb their hair. Even those who 
had been careful or even particular in 
their grooming now dressed carelessly 
and presented a slovenly appearance. It 
should be noted, however, that bathing 


was not neglected. It was a source of 
pleasure as it provided means of getting 
warm as well as a form of hydro- 
therapy; it was reported to have re- 
lieved aches, pains, and fatigue. 

Social initiative, and sociability in 
general, underwent remarkable change. 
Their earlier interest in having a voice 
in the making of policies and rules for 
the conduct of the non-scientific aspects 
of the experiment dwindled. The men 
became indecisive, unable to make per- 
sonal plans, and unwilling to participate 
in group activities. The subjects spent 
more and more time alone. It became 
“too much trouble” or “too tiring” to 
have to contend with other people. With 
the decline in the interests which had 
previously been held in common with 
others and with the growth of feelings 
of social inadequacy the men became 
self-centered. The egocentricity and as- 
sociated heightened irritability, of 
which the subjects were well aware, re- 
quired at times a real effort to maintain 
socially acceptable behavior. Too often, 
attempts to keep the interpersonal rela- 
tionships tolerable, if not gracious, pro- 
duced an uncomfortable and emo- 
tionally charged atmosphere in which 
politeness was artificial and social in- 
teraction stilted. Humor and_ high 
morale, which had been an outstanding 
characteristic of the group during 
standardization, gradually disappeared. 
Humor “dried up” and the tone of the 
group became sober and serious. What 
humor remained at the end of semi- 
starvation was mainly of the ironic and 
sarcastic variety. 

The men devoted much time and 
energy to the collection of recipes, 
studying of cookbooks, and contempla- 
tion of menus. The acquisition of coffee 
pots, hot plates, kitchen utensils, and 
the like on shopping “sprees” appeared 
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reasonable. Much less so was the buy- 
ing of old books, unnecessary second- 
hand clothes, knick-knacks, and other 
items which came to be known as 
“junk.” Often after making such pur- 
chases, which could be afforded only 
with sacrifice, the men would be puzzled 
as to why they had bought such more 
or less useless articles. This acquisitive 
behavior may be interpreted as a 
mechanism compensating for the depri- 
vation of food. Several subjects insisted 
that they had grown unusually anxious 
to save money for a “rainy day” and 
attributed this to the insecurity they 
felt in the experimental situation. 

In the later part of semistarvation, 
housekeeping chores were neglected and 
non-experimental Laboratory duties 
were carried out less and less effec- 
tively. The educational program, de- 
signed to prepare the men for foreign 
relief work and followed at the start 
with enthusiasm, in time quietly but 
decisively collapsed. As the distinction 
between the men and their non-starved 
associates became more pronounced, the 
subjects became strangely and some- 
what defensively aware of belonging 
to a “group.” The men_ exhibited 
heightened sympathy for an identifica- 
tion with the starving and _ suffering 
people throughout the world. 


Sex. Sexual feeling and expression de- 
clined to the point where at the end of 
the semistarvation period it was vir- 
tually extinguished in all but a few 
subjects. The decline of sex drive was 
so dramatic that the subjects were 
struck by the change and used colorful 
language to describe it. As one of them 
put it, “I have no more sexual feeling 
than a sick oyster.” The number of 
“dates” dropped drastically. Those who 
continued to ‘date’? found their rela- 
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tionships strained. Some of the men 
were surprised to find that this was 
also true in even those cases where their 
female contacts had appeared to be 
based on intellectual, social, and group 
interests. Such situations probably 
stemmed from decline in sociability as 
well as loss of sex impulses. Masturba- 
tion and nocturnal emissions were re- 
ported as absent or greatly reduced. 
Moreover, sex fantasies and sex dreams 
were reduced in number and when 
present were severely attenuated. 


Intelligence. Complaints of inability 
to concentrate for any period of time 
and of difficulty in developing thoughts 
became numerous. By the end of the 
semistarvation period a large propor- 
tion of the men felt that their judg- 
ment had been impaired. They reported, 
further, that their alertness and com- 
prehension had declined. Clinically, 
we had the impression that the intel- 
lective capacity was essentially un- 
changed ; this impression was supported 
by objective test evidence. Memory 
disturbances and decrease of expressive 
power were only rarely encountered 
and did not go beyond the range of 
normality. Throughout the stress the 
subjects thought clearly and talked in- 
telligently, and the self-estimates of loss 
of intellective abilities may be regarded 
as a function of physical disability and 
emotional factors. It was the narrow- 
ing of their interests, apathy, and lack 
of initiative in carrying on conversa- 
tion and study which led the men to 
conclude that they had suffered actual 
decline of intellective powers. 


RESULTS: REHABILITATION PHASE 


The purpose of the rehabilitation 
phase of the experiment was to measure 
the relative efficiency of several levels 
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of refeeding in order to secure the most 
efficient, practical, and economic regi- 
men for dietary rehabilitation. There 
was little change in the composition of 
diet, simply more of it. The average 
caloric intake was 2,448 Calories dur- 
ing the first six weeks, 3,257 Calories 
from the seventh to the tenth week, 
and 3,518 Calories during the eleventh 
and the twelfth week of controlled re- 
habilitation. Within the context of this 
report it is not possible to discuss the 
differential effects of the experimentally 
varied levels of caloric, protein, and 
vitamin intake. We shall, therefore, 
limit ourselves to a qualitative descrip- 
tion of behavior during the rehabilita- 
tion phase of the experiment. 

The process of recovery was slow. It 
should be emphasized that the psycho- 
biological stress of semistarvation ac- 
tually continued to a greater or lesser 
degree (depending upon the level of 
refeeding ) throughout the entire twelve 
weeks of controlled rehabilitation. 


Physical Changes. At the end of twelve 
weeks of controlled rehabilitation the 
subjects in the highest caloric group, 
which received 1200 Calories more 
than the lowest group, had regained 
less than sixty per cent of the weight 
lost. Those in the lowest group gained 
no weight during the first six weeks 
and by the end of the twelfth week had 
regained only twenty per cent of the 
weight lost in the semistarvation phase. 
Energy and physical well-being in- 
creased roughly in proportion to caloric 
intake. 

Recovery from dizziness, apathy, and 
lethargy was most rapid. Tiredness, 
loss of sex drive, and weakness were 
slow to improve. Although visible 
edema tended to disappear, in some 
men there was little change and even 


an increase in edema. Cramps, vague 
aches and pains, and paresthesias were 
unrelieved for some time. Some of the 
men had new complaints such as flatus, 
distension, belching, and stomach ache. 
Those subjects who gained the most 
weight became concerned about their 
increasing sluggishness, general flabbi- 
ness, and the tendency of fat to accu- 
mulate in the abdomen and buttocks. 

At the end of three months of re- 
habilitation even in those subjects who 
were maintained on the highest caloric 
intake, the overall physical condition 
was considerably inferior to the pre- 
starvation status. Later reports from 
the subjects indicated that it was not 
until an additional three months of 
“normal” living and super-normal eat- 
ing, beyond the twelve weeks of con- 
trolled rehabilitation, that their physical 
capacity approached pre-experimental 
levels. 


Food. During the twelve weeks of re- 
habilitation there was relatively little 
change in the subjects’ eating habits 
and attitudes toward food. The men 
continued to want more than they re- 
ceived. Even when those on the highest 
caloric intake were physically full, they 
wanted more—their appetites were in- 
satiable. The men continued to be con- 
cerned with food and their rations 
above all else. Food substitution habits 
persisted with only minor alterations. 
Heavy use of coffee, tea, “souping” of 
food, and generally high fluid intake 
continued to be characteristic for most 
of the rehabilitation period. Keeping 
foods hot, “formalities” of serving, and 
creation of mixtures and “concoctions”’ 
continued. About half a dozen of the 
men were more deteriorated in their 
eating habits and table manners during 
the first six weeks of the rehabilitation 
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period than during  semistarvation. 
There was little flagging in food in- 
terests and culinary matters, although 
the filing of recipes and the reading of 
cook books gradually declined. 


Emotions and Attitudes. For six 
months the men had looked forward to 
the last day of semistarvation as the 
day which would mark the end of their 
ordeal. They had anticipated that re- 
habilitation would bring about early 
alleviation of their symptoms and dis- 
tress. This belief was a sustaining moti- 
vation during the semistarvation pe- 
riod. The expected ‘‘new lease on life” 
did not materialize. As already stated, 
weight gains were small or non-existent 
(a few men even lost weight due to loss 
of edematous fluid). Weakness, tired- 
ness, pains, and myriad other discom- 
forts continued to contribute to their 
suffering. Hunger and appetite were 
not appeased. As one subject expressed 
himself, ““Now I go away from meals 
hungry three times a day instead of 
two.” 

Some men actually became more de- 
pressed and irritable than in semistarva- 
tion. Many grew argumentative and 
negativistic. Others professed grave 
doubts as to the value of the entire 
project or questioned the motives and 
competence of the experimenters. Sev- 
eral subjects confessed that their hu- 
manitarian concern for the welfare of 
mankind had become elusive and diffi- 
cult to maintain. Impatience, tenseness, 
and a feeling of a “let down” pervaded 
the group. After the first few encour- 
aging days of the rehabilitation regi- 
men there was a pronounced and de- 
cided slump in morale. 

However, the discontent and aggres- 
siveness, as distinguished from the 
apathy and acquiescence of semistarva- 
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tion, was an indirect evidence of an in- 
crease in energy. It foreran the gradual 
reappearance of physical, social, and 
cultural interests which had gone ‘“un- 
derground” for the duration of semi- 
starvation. No longer were the men 
willing to accept without question the 
formation of policy by those responsible 
for conducting the experiment. They 
insisted that the rules and regulations 
make “‘good sense’ to them. The men 
became increasingly impatient with the 
“buddy system” which was maintained 
until the sixth week of rehabilitation 
when it was finally removed in the face 
of imminent wholesale violation. Gen- 
eral unrest was reflected in the failure 
to re-establish efficient non-experimen- 
tal laboratory and work assignments. 

It was difficult for the men to aban- 
don or modify attitudes and habits 
which they had acquired during semi- 
starvation. In readapting to pre-ex- 
perimental interests and activities, the 
subjects were often frustrated by lack 
of supporting strength and endurance. 
The circumstances of normal living 
were appealing to the subjects long be- 
fore they were able to cope with them 
successfully. This added to the restless- 
ness and complicated the morale prob- 
lem. In the latter part of rehabilita- 
tion the cumulative effects of increased 
food intake and the nearing prospect of 
the end of the experiment brought 
about a noticeable improvement in 
morale. 

Humor, enthusiasm, and _ sociability 
progressively reappeared; and _irrita- 
bility and nervousness diminished. The 
strong sense of group identity was dis- 
sipated as the men once again looked 
forward to developing their own plans 
for the future and took up interests not 
immediately related to their participa- 
tion in the experimental program. The 
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distinction between the “in-group” and 
the “out-group” (i.e. the starved and 
well-fed) disappeared. 

Sex. The sexual impulses, needs, and 
interests were very slow in regaining 
their pre-experimental intensity. 


Intelligence. There was a pronounced 
decline in the number of complaints 
about the lack of alertness, inability to 
concentrate, poor comprehension, im- 
paired judgment, and deterioration of 
memory. However, the inefficiency and 
poor habits of study persisted. It was 
apparent that the men by and large did 
not resume their academic studies and 
intellectual pursuits with the application 
and vigor that was characteristic of 
their efforts during the control period. 


Resuits: Post-ExX PERIMENTAL 
PHASE 

On October 20, 1945 (the end of the 
twelfth week of controlled rehabilita- 
tion and the forty-eighth week of the 
experimental regimen) twenty of the 
thirty-two subjects were released alto- 
gether from dietary and experimental 
restrictions. The twelve men selected to 
remain at the Laboratory for further 
study were relieved of all dietary re- 
straints over week-ends. Thus on the 
weekend of October 20, the whole 
group was at long last free to satisfy 
their personal food cravings and, most 
importantly, to eat as much as they 
wanted. The men gorged prodigious 
quantities of food which approximated 
.six to seven thousand calories per day. 
Many ate more or less continuously 
throughout the two-day period. Some 
reported eating as many as three con- 
secutive lunches. In many cases the 
men were not content to eat “normal” 
menus but persevered in their habits of 


making “concoctions” and combina- 


tions which could only be described as 
fantastic. The free choice of ingredi- 
ents, moreover, stimulated ‘“‘creative”’ 
and “experimental” messing with food. 
Licking of plates and neglect of table 
manners persisted. Attempts to avoid 
wasting even a particle continued in 
the face of unlimited supplies of im- 
mediately available food. An irrational 
fear that food would not be available 
or that the opportunity to eat would 
somehow be taken away from them was 
present in some of the men. This may 
have motivated their eating as much 
as they could hold at any given time. 

Generally, the men ate more food 
than they were prepared to cope with. 
This gluttony resulted in a high inci- 
dence of headaches, constipation or 
diarrhea, intestinal distension, belching, 
Hatus, and unusual sleepiness. Several 
men had spells of nausea and vomiting ; 
one became acutely ill and required hos- 
pitalization for a week. Follow-up 
studies made at thirty-three and fifty- 
five weeks after the end of semistarva- 
tion showed that the men had returned, 
by and large, to their pre-experimental 
“normal” status except that a number 
of men exceeded their pre-starvation 
weight. 

DiscussION 


Methodological comment. This paper 
presents clinical observations, impres- 
sions, and generalizations derived from 
formal and informal contacts with the 
subjects and from descriptive protocols 
including diaries and interviews. The 
subjects were observed under such 
varied conditions as individual and 
group testing sessions, personal inter- 
views, clerical and technical laboratory 
work, participation in group meetings, 
at times when the authors ate with the 
men, etc. Test results and ratings were 
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mentioned only occasionally and were 
used as evidence supporting and/or 
supplementing qualitative clinical judg- 
ment. The parallel use of the clinical 
approach and standardized testing tech- 
niques facilitates interpretation of the 
data and has the advantage of provid- 
ing for cross-validation of the findings. 


Magnitude of the — semistarvation 
changes. The fact that it was possible 
to complete successfully the experiment 
indicates that neither the physical nor 
mental health of the group was affected 
to a pathological degree. At no time 
was it necessary to omit a test or an 
interview because of lack of coopera- 
tion or incapacity of the subjects which 
was due to semistarvation alone. Many 
ef the physical and psychological al- 
terations may be considered as adaptive 
and protective. For example, reduction 
of basal metabolism conserved energy ; 
likewise, reduction in social participa- 
tion resulted in decreasing demands 
upon the energy of the organism. Other 
changes were frankly deteriorative, 
such as development of edema, loss of 
muscle tissue, lack of endurance, re- 
duction in concentration and _ self- 
discipline. The character and magni- 
tude of these changes were such as to 
render the men increasingly inefficient 
in their daily living. However, persons 
who came into superficial contact with 
the subjects did not notice anything 
strikingly abnormal about their be- 
havior even though it was drastically 
altered from their pre-starvation norm. 





Similarity between experimental and 
non-experimental semistarvation and 
rehabilitation. Sorokin(14) criticized 
experimental studies on starvation in 
man as lacking in realism. In spite of 
this criticism the picture of semistarva- 
ton as seen in the Minnesota Experi- 





ment resembled in all essential points 
the effects of famine as presented by 
Sorokin in his monograph. For a direct 
tomparison with the changes observed 
in the Minnesota Experiment, digests 
of a few representative field reports on 
war-time semistarvation will be pres- 
sented. 

The severely undernourished persons 
seen in 1942 in internment camps in 


southern [I*rance(13) universally ex- 
hibited weakness, exhaustion, and 
apathy. Their body temperature was 


lowered, and they were sensitive to 
cold; the onset of warmer weather was 
reflected in an improved sense of well- 
being. The facial expression was pain- 
ful (“facies dolorosa”), sometimes 
mask-like. There was an acute desire 
for food in large amounts and_fre- 
quently individuals had to be torn away 
from refuse cans. Schwarz noted that 
the increase in the desire to eat (hyper- 
orexia) tended to last long after the 
patients became well. Even in the treat- 
ment of edematous cases the food had 
to be mixed with large amounts of 
liquid in order to make up the quantity 
desired by the patients. The daily bread 
rations had to be divided into three por- 
tions and given out separately, other- 
wise all the bread would be eaten as 
soon as it was received. Polyuria and 
nocturia were universal. Marked neu- 
rological changes were observed rarely 
and then only in the terminal stages of 
starvation. 

Similar findings were obtained in 
Leningrad in 1941-42015). Because of 
the German blockade the supply of food 
to the city decreased rapidly and the 
progress of starvation approximated 
the rate of weight loss present in the 
Minnesota Experiment. The first clini- 
cal symptoms of ill-being began to ap- 
pear in the population about four weeks 
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following drastic reduction in food 
supply. Emaciation and decrease in 
strength became noticeable. Numerous 
cases of generalized weakness and oc- 
casional fainting came to the attention 
of the Leningrad First Aid Service. 
The effects of the blockade on the health 
of the population were complex. There 
were cases of simple semistarvation un- 
complicated by symptoms of hypovi- 
taminosis, but frequently there were 
added the effects of qualitative malnu- 
trition and of intercurrent infectious 
diseases. In a sample of forty-eight 
semistarvation patients all but one com- 
plained of increased fatigability. All had 
lost weight, the most frequent loss be- 
ing between twenty and twenty-five per 
cent of the prestarvation level with a 
range of between ten and thirty-three 
per cent. Polyuria, sensitivity to cold, 
dryness of the skin and hair, aches and 
pains in the extremities, and amenor- 
thea were frequent. No important 
visual disturbances were reported. Psy- 
chologically. various degrees of per- 
sonality deterioration were observed: 
apathy, dulling of the emotions, lower- 
ing of the moral level, and narrowing 
down of intellectual interests(4). Psy- 
chotic involvements were rare. 
Psychological investigation by means 
of interviews was carried out(12) on a 
group of internees who lived through 
the starvation at the Belsen concentra- 
tion camp in Germany. The author’s 
main task was to examine patients who 
needed psychiatric attention and who 
were referred to him by other physi- 
cians. In addition, he examined some 
sixty cases in the hospital and con- 
valescent areas selected at random to 
represent a cross-section of the camp 
population. Unfortunately, in his de- 
scription the information from these 
two sources is not clearly differentiated. 


























The nutrition was extremely poor ; nine 
ounces of bread and two pints of turnip 
soup were given as the daily ration. At 
the time of liberation, the camp was es- 
timated to contain about 50,000 people 
with some 10,000 lying dead in the 
huts and around the camp. In the semi- 
starved inmates of the camp there was 
a marked reduction in activity, reach- 
ing in some cases the form of com- ~ 
plete immobility. Many internees did — 
not have enough strength to walk. A — 
common reaction was the loss of appre- — 
ciation of social ties, each individual © 
living entirely for himself; family had 7 
little meaning. Responsiveness to death, q 
cruelty, and humiliation was blunted, 7 
and the individuals became apathetic 
to incidents in the camp. Many showed 
discouragement, seclusion, introversion, 7 
and depression. Only a minority ex- 7 
hibited aggressive reactions. Impair- 7 
ment of memory appeared common. ~ 
Carelessness in appearance, particular) a 
in men, tended to persist even after 
liberation. In women the sense 0! © 
modesty was dull or lacking. Interest; 7 
were severely narrowed down to mat- 7 
ters of food. The inmates were con- ~ 
tinually hungry, and it was reported! — 
that in the last stages of the camp be: ~ 
fore liberation cases of cannibalism hai 7 
occurred. Even after the danger 0! — 
starvation ceased and anxiety abou — 
food was objectively without grounds” 
the semistarvation reactions such a 
stealing, hiding, and “saving” food per” 
sisted. As nutritional rehabilitation” 
progressed, the pattern of complaint: 
changed. Whereas before the patient: 7 
complained wearily and hopelessly, late’ ” 
the complaints became fierce, bitter, an’ 
resentful. Cases with frank psycho 
pathology were few in view of the har 
rowing experiences, the physical suffer 
ing, and the fear of hunger, torture 
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and death to which the internees were 
exposed. There were cases of conver- 
sion hysteria, expressed in the inability 
to hear or see. Delusions were rare. A 
few patients exhibited maniacal out- 
bursts. 

There are many similarities between 
our experimental findings and the con- 
ditions described in the above reports. 
The loss of weight and the physiologi- 
cal changes were essentially typical of 
those encountered in non-experimental 
semistarvation. This was confirmed by 
Major Marvin Corlette, M.C., who 
made extensive observations on mal- 
nutrition in northwestern Europe at the 
time of liberation and who visited the 
Laboratory in July, 1945, at the end of 
the semistarvation period. He stated: 


oe 


.... the salient clinical features 
of the picture we saw at Minneapolis 

. very closely simulated the pic- 
ture of semistarvation seen in west- 
ern Holland as well as in some of the 
German concentration camps in the 
early spring of 1945. Except for the 
absence of filth and secondary skin 
infections in the experimental sub- 
jects, it appears that the fundamental 
clinical pattern of partial starvation 
as we observed it in Europe has been 
duplicated.”’(5) 


The intrinsic psychological effects of 
semistarvation are also practically iden- 


tical under both conditions: intense 
hunger, preoccupation with thoughts of 
food, marked emotional changes (e.g. 
depression, apathy, irritability), loss of 
sex drive, and overall suffering. The 
somewhat inimical social climate in 
which the men as conscientious objec- 
tors had moved prior to participating 
in the experiment and the unavoidable 
regimentation of their lives as subjects 
may be considered to have engendered 
psychological stresses analogous in 
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some degree to the personal and social 
insecurity usually experienced by fam- 
ine victims. 

The behavior of the subjects during 
nutritional rehabilitation in the Minne- 
sota Experiment had its counterpart in 
patients who suffered from natural 
semistarvation and were later placed on 
hospital diets. In this context reference 
may be made to the released Indian 
prisoners of war who lost on the aver- 
age about twenty-five per cent of their 
body weight during their internment 
by the Japanese(11). After admission 
to the 47th British General Hospital, 
Singapore, they were served four meals 
daily. Between the main meals the 
men were given milk drinks with bis- 
cuits, sweets, or chocolates. The light 
hospital diet provided an_ estimated 
3,384 Calories; the ordinary hospital 
diet 4,260. As a rule the men had very 
large appetites which were not satisfied 
by these diets. Overeating was often 
followed by flatulence and abdominal 
distension. Sometimes diarrhea was 
present. Gastrointestinal discomfort 
lasted from a few hours to a few days. 
In severely debilitated persons overeat- 
ing had serious results including sud- 
den collapse, low blood pressure, a rapid 
feeble pulse, cold extremities, and stu- 
por. In our group there was only one 
man who needed hospitalization because 
of gastrointestinal and cardiac symp- 
toms resulting from overeating al- 
though minor distress was experienced 
by a considerable number of our sub- 
jects when they were released from all 
dietary restrictions. 


Factors specific to the Minnesota ex- 
periment. In spite of the many simi- 
larities between the picture of experi- 
mental and “natural” semistarvation, 
we do not wish to minimize the specific 
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factors present in the Minnesota Ex- 
periment. The subjects were specially 
selected and constituted a group which 
was neither a random nor a cross-sec- 
tional sample of the population. Certain 
aspects of the experiment tended to 
mitigate the severity of the stress as 
compared with non-experimental semi- 
starvation. The men had clean, health- 
ful living accommodations with ade- 
quate sanitary facilities, including soap, 
hot water, and other comforts. They 
had sufficient clothing and adequate 
medical supervision and care. All food 
skillfully prepared and_ served. 
Since the subjects were not permitted 
to eat off-diet, the danger of ingesting 
contaminated food or harmful substi- 
tutes was eliminated. Neither did they 
get the opportunity to gorge from time 
to time. The men had strong intel- 
lectual, religious, humanitarian, and 
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ethical values which played an impor- 
tant role in the maintenance of morale 
and in keeping the men from getting 


into “trouble.” Unquestionably, the 
subjects possessed a rare capacity for 
continuous denial of the demands of in- 
tensive hunger. 

Certain sources of insecurity present 
in conditions of “natural’’ famine were 
absent in this experiment. The sub- 
jects knew that the stress would come 
to an end at a predetermined date and 
that rehabilitation would follow. They 
knew when and what food would be 
served and that it would be available 
without fail. There was no competi- 
tion as to who got what to eat and, 
therefore, no question of fending for 
it. The men were protected in other 
ways. When they were too weak or 
ill, arrangements were made so that 
their work and “guinea-pig” duties 
were postponed or re-scheduled. More 
importantly, they were free from po- 


litical turmoil and oppression, bombing, 
threat of sudden death or injury, 
destruction and loss of property. Fur- 
thermore, crime, theft, depravity, ex- 
ploitation, and other socially disruptive 
concomitants of non-experimental semi- 
starvation were not present. 

On the other hand, some of the pro- 
visions and restrictions imposed by the 
experimental regimen increased its 
severity as compared with non-experi- 
mental situations. The subjects starved 
in the midst of plenty. The drastic 
limitations of personal freedom re- 
quired by the experimental program 
itself was a hardship. Being volunteers, 
they could have withdrawn from the 
experiment; for this reason conflicts 
and tensions were generated which 
made the experimental semistarvation 
more difficult to endure. In the experi- 
mental situation the subjects were un- 
able to improve their nutritional condi- 
tion through ingenuity and individual 
effort as is often possible in “natural” 
semistarvation. 

It is worthwhile to examine the hy- 
pothesis that the necessary controls and 
grueling regimen of the experiment, 
aside from diet, heightened significantly 
the psycho-biological stress and con- 
tributed to the behavioral changes. On 
this point we have only indirect but 
relevant evidence; twelve subjects serv- 
ing in another nutritional experiment, 
who lived in the same quarters as the 
semistarvation subjects and under simi- 
larly controlled experimental conditions 
but on an adequate diet, gave no evi- 
dence of the behavior changes charac- 
teristic of semistarvation. It is believed 
in view of this fact that the rigorous 
experimental regimen as such did not 
distort for the group as a whole the 
personality changes induced by starva- 
tion. 
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Comparison of the Minnesota experi- 
ment with other experimental investi- 
gations. The psychological effects of 
semistarvation have been studied in the 
past primarily during acute and, as a 
rule, short-term starvation. Since these 
situations differ radically from pro- 
longed semistarvation, there is no need 
to review this material. 

There is only one experiment, carried 
out in 1918, which is somewhat similar 
to the present investigation(1). The 
effects of semistarvation on the well- 
being and personality of our subjects 
closely paralleled the changes observed 
by Benedict and his collaborators in 
their study on prolonged undernutri- 
tion. However, in the Minnesota Ex- 
periment, the alterations were much 
more marked. This is understandable 
because the period of reduced food in- 
take in the present study was one-third 
longer and the average weight-loss was 
twenty-four per cent as compared with 
a decrement of 10.5 per cent in the 
case of the twelve subjects observed 
by Benedict. It may be expected that 
the strain of semistarvation bears an 
exponential rather than a linear rela- 
tionship to the loss of body weight. 


Use of conscientious objectors as sub- 


jects. Because conscientious objectors 
are members of a small minority group 
and, as such, known to relatively few 
people except in a stereotyped and su- 
perficial way, some comments on the 
subjects as persons rather than as 
“guinea-pigs” may be pertinent. More- 
over, descriptive and identifying infor- 
mation may serve to forestall unwar- 
ranted criticisms of the experimental 
findings based on the status of the sub- 
jects as conscientious objectors. 

Before the men were transferred to 
Minneapolis to serve as experimental 
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subjects, they had been engaged in a 
variety of jobs classified as “civilian 
work of national importance.” princi- 
pally manual labor in work camps but 
also in special projects where they 
served as orderlies and attendants in 
mental hospitals, ete. Over a hundred 
men responded to the call for volunteers 
as “human guinea-pigs” in the starva- 
tion-rehabilitation experiment. Those 
candidates whose applications were ap- 
proved after careful screening were 
physically examined and_ interviewed 
by Laboratory personnel before final 
selection. The men finally accepted 
were chosen according to these criteria : 


l‘reedom from history of disabling dis- 
eases including mental illness. 

Absence of physical disabilities or hand- 
icaps. 

Ability to cooperate and get along well 
with others. 

Willingness to subordinate personal in- 
terests, activities, and welfare to the 
requirements of the experimental 
program. 

Active interest in problems of nutri- 
tional relief and rehabilitation. 

Freedom from marital or familial re- 
sponsibilities. 


The individuals — selected — were 
healthy, intelligent, young, white males 
representing a wide range of body type, 
physical endurance, personality charac- 
teristics, and socio-economic — back- 
ground. According to clinical evalu- 
ation as well as the results of objective 
measures of personality, only their paci- 
fist convictions set these men apart 
from other men of similar age, health, 
intelligence, education, and background. 
The immature and neurotic personality 
traits evidenced in a few men prior to 
the experiment were either sub-clinical 
or mild. The men were highly regarded, 
both as subjects and as persons, by 
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those with whom they worked and as- 
sociated. It seems safe to assume that 
any sample-bias present in the experi- 
mental findings errs on the conserva- 
tive side. The psycho-biological ‘‘stami- 
na” of the subjects was unquestionably 
superior to that likely to be found in 
any random or more generally repre- 
sentative population sample. It is un- 
likely that such a sample of subjects 
could be kept to the grueling regimen 
for the necessary duration of such an 
experiment. It should be remenibered 
that the subjects could eat nothing but 
what the Laboratory prescribed and 
provided for almost a year. Moreover, 
for many, at the levels of refeeding 
used, rehabilitation was, for weeks, 
little more than a painful continuation 
of the six months of semistarvation 
stress. 
SUMMARY 


Observations are reported on_ be- 
havioral changes which occurred in 36 
volunteer subjects during a semistarva- 
tion-rehabilitation experiment. 

Six months of semistarvation pro- 
duced marked deteriorative and adap- 
tive changes in all subjects. The men 
lost twenty-four per cent of their initial 
gross body weight. The physiological 
responses to undernutrition included 
such changes as decrease in the pulse 
and basal metabolic rate. A large num- 
ber of men suffered from edema. The 
subjects complained of weakness, fa- 
tigability, sensitivity to cold, giddiness 
on. arising, polyuria, distressing sensa- 
tions of hunger, and other aches and 
pains. 

The personality changes were “‘psy- 
choneurotic” in type and although not 
grossly pathological, rendered the sub- 
jects increasingly ineffective in their 
daily living. The men exhibited symp- 


toms of depression, irritability, ‘‘ner- 
vousness,’’ and general emotional in- © 
stability. Social withdrawal, narrow. ~ 
ing of interests, obliteration of sexua! ~ 
drive, and difficulty in concentration — 
were prominent. Food and eating be. 
came their dominant concern. 7 
Marked individual differences were ” 
present in both the degree of overall de. ~ 
terioration shown in starvation and in 3 
the rate of recovery. During the period — 
of rehabilitation, return to “normal” ~ 
was unexpectedly slow and in general — 
paralleled the levels of caloric intake ~ 
Feeling of well being, range of inter. — 
ests, emotional stability, and socia- 7 
bility were regained more rapidly than | 
strength, endurance, normal eating 7 
habits, and sexual drive. 


ACKNOWLEDGMENT 


We wish to express our sincer — 
thanks to the senior staff of the Labora-— 
tory of Physiological Hygiene, espe 7 
cially Drs. Austin Henschel, H. L. 
Taylor, Samuel Wells, and Miss Angie 7 
Mae Sturgeon for their observation: — 
and clinical comments. Mr. H. Guetz- — 
kow participated in the experiment a — 
an assistant psychologist and shared in — 
full the burden of interviewing ani | 
testing. Particularly, we wish to thank — 
the thirty-six subjects without whos — 
cooperation this research would not | 


have been possible. 

REFERENCES : 

Beneoicr, F. G., Mites, W. R., Rorn, P. 7 
and Smirn, H. M. Human vitality an 7 
efficiency under prolonged restricted dic 7 
Carnegie Inst. Wash. Publ. No. 280, 1919. © 
Brozek, J., ALEXANDER, H., and Keys, \ 7 
Analysis of variance in an experiment 0! ~ 
nutritional rehabilitation in man (in press) 7 
Brozek, J.; and Keys, A. General aspects 3 
of interdisciplinary research in experiment: — 
human biology. Science, 1944, 100, 507-512 7 

. Cuernorutskil, M. V. Problem of alimen 7 
tary dystrophy. Studies Leningrad Phys 7 





THE SARGENT TEST 4+ 


cians during War (in Russian), 1943, 3, 
3-13. 

5. CorvetTe, M. 
1945. 

5. GuerzKow, H. S., and Bowman, P. H. 
Men and Hunger: A psychological manual 
for relief workers. Elgin, Ill.: Brethren 
Publishing House, 1946. 

_ Keys, A. Human starvation and its conse- 
quences. J. Amer. Diet. Assoc., 1946, 22, 
582-587. 

_ Keys, A., Brozex, J., HENSCHEL, A., MIcK- 
ELSEN, O., and TAyLor, H. L. Experimental 
starvation in man. Publ. Lab. Physiol. Hyg., 
Univ. Minn., 1945. 

_ Keys, A., MICKELSEeN, O., HENSCHEL, A., 
Brozek, J., and Tayior, H. L. Later stages 
of rehabilitation following experimental 
starvation in man, Publ. Lab. Physiol. Hyg., 
Univ. Minn., 1946. 

. Keys, A., Taytor, H. L., MICKELSEN, O., 
HeENscHEL, A., and Brozek, J. Rehabilita- 
tion following experimental starvation in 


(Personal communication), 


man, Publ. Lab. Physiol. Hyg., Univ. Minn., 
1946. 

MITCHELL, J. B., and Brack, J. A. Malnu- 
trition in released prisoners of war and in- 
ternees at Singapore. Lancet, 1946, 2, 855- 
862. 

NIREMBERSKI, M. Psychological investiga- 
tions of a group of internees at Belsen camp. 
J. Ment. Sci., 1946, 92, 60-74. 

ScHWARz, O. Beobachtungen und Erfah- 
rungen bei der Hungerkrankheit im Lager 
von Gurs (Stidfrankreich). Schweiz. med. 
Wehnschr., 1945, 75, 1136-1137. 

Sorokin, P.O. Man and society in calamity. 
New York: Dutton & Co., 1942. 

. Tusuinsku, M. D., ALEsuina, F. J., and 
Zeits, Z. R. Clinical observations on 
patients with alimentary dystrophy in quan- 
titative and qualitative malnutrition. Stud- 
ies Leningrad Physicians during War (in 
Russian), 1943, 3, 14-24. 

Zim, H. S. What happens when people 
starve. Liberty, Feb. 17, 1946, 16-17, 75-77. 





A PRELIMINARY INVESTIGATION OF THE 


KATHERINE 


SARGENT TEST! 


K. FASSETT 


University of Wisconsin 


PROBLEM 


Sargent has recently made an at- 
empt to incorporate the principles of 
projective methods into a group paper- 
and-pencil personality test, thus com- 
bining the administrative advantages 
bf a written test with the diagnostic 
value of a projective technique(1). The 
heory and principles which lie behind 
his Test of Insight into Human Mo- 
ives are reviewed and summarized in 
er more recent article(2). Further in- 
yestigation of this test has formed the 
basis of the present study. The test 
omprises situations, briefly described, 


1. The writer is grateful to Dr. Ann Magaret 
pf the Department of Psychology, University of 
isconsin, for her advice and guidance in the 
study and thesis on which this article is based, 
as well as for her further aid in the revision 


in which the major conflict areas of 
personality are emphasized, followed 
in each case by the questions, ‘““What 
did he (or she) do and why?” and 
“How did he (or she) feel?” The 
subjects are instructed to write answers 
to the situation-question items, called 
armatures, in any order they like and 
as many as they like. The replies are 
scored by the classification of feeling 
and cognitive expressions, types of con- 
flict solution, maladjustment indicators, 
and various counts and ratios of these. 
Sargent considers her test to be suf- 
ficiently promising to warrant further 
experimentation, and has made a num- 
ber of suggestions for further research. 

Sargent used alternative forms to 
determine the reliability of the test and 
concludes that there is “‘at least a sus- 
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picion that homogeneity of forms, or 
of groups who took them, is lacking”’ 
(1, p. 17). Consequently it seemed worth 
while to compute reliability by the test- 
retest method. The reliability of the 
scoring system was found to be satis- 
factory as measured by inter-judge 
agreement and by agreement of re- 
peated scoring by the same judge. She 
felt, however, that the scoring system 
is complex and in need of revision, and 
that validation studies are not indicated 
with the scoring system in its present 
form. Although she made suggestions 
for revision and simplification, it was 
felt, after working with her scoring 
system in this study, that a new de- 
parture might yield a system even 
simpler, which could be so developed 
as to be of value clinically and experi- 
mentally. With regard to the complete 
freedom which Sargent allowed her 
subjects in choice of armatures to be 
answered, it would seem a@ priori that 
more significant material could be 
drawn out by making sure that the sub- 
ject touches on as many conflict areas 
as possible. Since one of the principles 
of projective techniques is that they 
tap areas which the subject is reluctant 
to reveal, it is conceivable that an en- 
tirely unrestricted choice might lead to 
the omission, intentional or not, of 
painful areas. 

The present study, then, seeks to do 
three things out of the many possible 
areas to be investigated in the Sargent 
test: (1) to further examine the re- 
liability of the test; (2) to develop a 
simpler scoring system; and (3) to try 
out a different method of presentation 
whereby the subjects are required to 
touch on as many conflict areas as pos- 
sible instead of being given the com- 
plete freedom of choice which Sargent 
allowed. 
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PROCEDURE 


An experimental procedure was 
worked out on Sargent’s Form 1W for 
purposes of the present investigation, 
wherein the armatures were grouped, 


according to content, under the various — 


conflict area headings. These conflict 
areas are: family, vocation, opposite 
sex, social and friendship, religion and 
opinion, and health. In cases of over- 
lapping of areas within a single arma- 
ture, assignment was made arbitrarily. 


Ideally each conflict area should have — 


included an equal number of arma- 


tures from which the subject could © 
choose, but with the armatures and con- ~ 


flict areas as given by Sargent, this 
proved impossible. The directions on 


the revised form were copied directly 4 
from Sargent’s, with only the interpola- 7 


qi 


tion of such phrases as instructed the 7 


subjects to answer one question from 7 
each group before going on to any ~ 
more that they might like, and to iden- ~ 


tify each armature by both group letter 
and individual number. The groups 


were labelled simply by letter, with no 7 


indication of their nature. This revised 
version of the test is referred to as the 
X-form, while the original Sargent 
version, with the questions presented 
in numerical order and the subjects in- 
structed to answer as many as they 
like in any order they like, is referred 
to as the S-form. 


Subjects. The subjects were women q 
from the beginning psychology classes — 


at the University of Wisconsin in the ~ 


fall of 1945, who volunteered for “a 


simple written experiment in connec- © 


tion with the study of group tendencies ~ 


in college students.” All four under- © 


graduate classes were represented, and — 


the ages ranged from 18 to 23. Using 3 
the Sargent procedure, 25 women were 7 
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given the original or S-form of the 
test, these same subjects taking a re- 
test on the same form six weeks later ; 
a group of 25 different subjects took 
test and retest, with the same time in- 
terval, on the experimental or X-form 
of administration. 


Scoring. All of the scoring on the 5S- 
form papers was done by the writer, 
referred to as Scorer A, using the Sar- 
gent scoring system. The X-form 
papers were scored according to the ex- 
perimental scoring system. Scorer A 
scored both test and _ retest, while 
Scorer B, a graduate student with clini- 
cal training, scored independently the 
papers of the original test only.* 

The experimental system used for 
scoring the X-form papers was de- 
veloped out of consideration of what 
could be identified in brief, easily 
scorable, communicable form. Each an- 
swer was scored according to four clas- 
sifications: Interpretation: the central 
character's conception of the problem 
stated in the armature; Approach: the 
central character's method of consider- 
ing the problem, steps followed or con- 
clusions reached in the course of com- 
ing to a solution; Solution: what the 
central character does to solve the 
problem; and Effect: the result of the 
solution on the central character's ac- 
tions or thinking. Each of these four 
classifications comprises two opposing 
categories: Interpretation might be 
either Intra-personal or Extra-per- 
sonal; Approach, either Active or Pas- 
sive; Solution, either Attack or Es- 
cape; Effect, either Tension-reducing 
or Non-tension-reducing. The selec- 
tion of these classifications and cate- 


2. The writer extends thanks to Miss Helen 


Clementson of the Department of Psychology, 
University of Wisconsin, for her help in this 
connection. 





gories for scoring was made on the 
basis of what the clinical psychologist 
would like to get, in brief but inclusive 
form, as indices to personality and to 
preferred mechanisms of adjustment as 
revealed in replies to questions such as 
are used in the Sargent test. The terms 
“classification” and “category” are, of 
course, arbitrary, as are the methods of 
enumerating and evaluating the scores. 

The scoring was done on separate 
sheets, one for each subject. The me- 
chanical work was simple: a_ check 
mark was put in the appropriate cate- 
gory cell for each classification for 
every question on a paper; when an 
entire paper had been scored, the num- 
ber of check marks for each category 
was totalled at the bottom of the 
column. Each of these totals was then 
divided by the total for the classifica- 
tion, that is, the sum of the totals for 
both categories in that classification. 
This was done in order to take into ac- 
count the different number of questions 
answered on different papers. Ordi- 
narily the number by which the cate- 
gory totals were divided was the same 
as the number of questions answered, 
since the categories were mutually ex- 
clusive and a given answer would be 
scored under one or the other but not 
both. An exception to this fact occurred 
when alternative situations were de- 
scribed in the reply, thereby implying 
both categories of the same classifica- 
tion. In such cases, both categories re- 
ceived a check mark. Both categories 
were not checked, however, simply be- 
cause indications for both could be 
found in the reply. In a great many 
answers both intra- and extra-personal 
factors would be found to enter into 
the subject’s conception of the prob- 
lem, for instance, and similarly for the 
other classifications. It was considered 
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that the scoring system loses its mean- 
ing when both categories are checked 
on such evidence ; preference was given 
to the category more clearly indicated, 
or more fully or definitely stated. Even 
when alternative situations were de- 
scribed by the subject, such as, “If the 
girl or her family had money enough 
to see her through the four years, she 
would go to the college of her choice, 
but if finances were a problem, she 
would accept the scholarship to the 
other school.” In such cases, if the same 
category would apply in both instances, 
it was given only one check-mark, not 
two. The entering of more check- 
marks than questions for any given 
classification, then, applied only to those 
answers where alternative situations 
clearly implied two opposing categories. 
Such instances appeared only six times 
in the seventy-five scoring sheets of 
this experiment. 

It is believed that the identification 
of these categories, while not yielding 
anything approaching a complete per- 
sonality picture, will present valuable 
indicators for further investigation 
where this seems desirable, and will, in 
itself, give a useful “thumb-nail sketch” 
of the subject’s reaction to conflict 
situations, assuming that her approach 
to these hypothetical situations is more 
or less representative of her reactions 
in real life situations. This scoring 
system might prove applicable to other 
projective devices of the thematic ap- 
perception type, although it is built 
around stimuli which definitely imply 
a conflict situation rather than those 
which are less likely to involve problem 
solving. It is not intended that this 
scoring get out of the replies every- 
thing that it is possible to get out of 
them. It does not preclude going back 
to the reading of the papers for further 


information, or for the application of 
additional scoring devices; this system, 
unlike Sargent’s, does not necessitate 
any notations on the papers them- 
selves. * 


RESULTS AND DISCUSSION 


Investigation of Sargent’s form of ad- 
ministration, 


Reliability. As stated earlier, vari- 
cus methods of computing scores had 
been used in the Sargent study. For 
the present investigation, the reliability 
of the Sargent test was computed on 
the basis of the F/C ratio; this score 
Sargent had found to distinguish more 
clearly than other scores between the 
means of her groups. The I°/C ratio 
expresses the ratio between the feeling 
and the cognitive expressions found in 
each paper. Accordingly these expres- 
sions were identified and the scores 
weighted, using the Sargent method, 
and the resulting F/C ratios computed. 
Test-retest reliability on the basis of 
these scores was + .46, significant at 
the 2% level of confidence. 

Sargent had correlated individual 
F/C scores on alternative forms and 
obtained an r of + .26, not significantly 
different from zero. The fact that this 
reliability is not as high as the test- 
retest reliability found in the present 
study may be due to a difference in the 
alternative forms of the test. Sargent 
concludes the possibility of such a dif- 
feretice from her investigation of the 
distribution of category frequencies be- 


3. A complete description of the experimental 
scoring system, including directions to scorer 
and a copy of the scoring sheets, will be fur- 
nished to anyone interested. Also available are 
copies of both forms of the test, and a list of 
armatures tabulated as to conflict area assign- 
ment on the X-form. Address: Mrs. N. C. 
Fassett, Student Counseling Center, University 
of Wisconsin, 740 Langdon Street, Madison 6, 
Wisconsin. 
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q TasLe 1. Difference in mean number of conflict areas answered by S- and X-groups 
¥ (original tests) 











Mean no. 
4 conflict o o 
a Group areas o mean Diff. diff. C.R. 
S 5.08 89 18 
xX 5.96 2» 04 88 18 4.89 








tween her normal groups on the two 
forms of the test, using Chi-square 
tests. 

The test-retest reliability of + .46, 
while not impressively high, is rea- 
sonably good for a projective tech- 
nique. In the way in which this scor- 
ing was done, however, the expendi- 
ture of effort and time seems out of 
proportion to the results obtained. The 
scoring procedure is long and involved, 
and the resulting ratio, according to 
Sargent’s investigations, does not give 
more than an indication of difference 
hetween groups whose composition was 
determined simply on the basis of the 
members being either university stu- 
dents or patients in a mental hospital. 
Sargent used as subjects students at 
Northwestern University, referred to 
as the NU group, and patients at the 
Elgin State Hospital, referred to as 
the k group. She points out that in 
interpreting the results it is necessary 
to guard against generalizing for either 
group as a whole because of their as- 
sorted composition, calling attention to 
the fact that in the NU group there 
may have been prepsychotics or cases 
of severe neurosis, whereas in the E 
group, certain cases about to be dis- 
charged may be considered relatively 
well adjusted. It seems rather likely 
that so broad a differentiation amongst 
subjects could be obtained, with at least 
as good reliability, by some measure 
less complicated and time-consuming 
than the F/C ratio. There is, however 


the possibility that further work with 
the I*/C ratio may show that it indi- 
cates something more than this broad 
group differentiation. Furthermore, the 
evaluations which have gone into the 
computation of this ratio could be dealt 
with in other ways, in other combina- 
tions or singly, and by various means 
of interpretation. Should such work 
yield measures which promise to be 
useful clinically, then the labor and 
time necessitated by the Sargent system 
might be justified. 


Conflict area comparison between 
forms. The X-form of test administra- 
tion was devised, as already explained, 
on the @ priori assumption that the 
more conflict areas are answered, the 
more significant material will be drawn 
out. A comparison was made of the 
original tests of the S-form and the 
X-form as to the number of different 
conflict areas answered. A conflict area 
was indicated as being answered re- 
gardless of the number of questions 
chosen under that area. On the S-form, 
each question was assigned to that con- 
flict area under which it had been 
grouped on the X-form. Because this 
analysis did not take into account the 
total number of questions answered, a 
comparison of the two forms was made 
in this respect also. The results show 
that the X-form in this experiment 
called forth answers to a significantly 
greater number of conflict areas, and 
the S-form to a significantly greater 
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number of questions. 
and 2.) 


Neither of these comparisons takes 
into account the total length of papers, 
since the length of single answers 
varies. But it is evident from inspection 
of the papers, which were all type- 
written to facilitate comparison, that 
the S-form papers were definitely 
longer than those of the X-form. Since 
the two groups worked for approxi- 
mately the same length of time, the rea- 
son for this difference in length is not 
clear. It might be that the necessity for 
making choices among several different 
groups took time which was not re- 
quired of the subjects who had free- 
dom of choice in the ungrouped arma- 
tures. It might be that the instructions 
on the X-form to answer one question 
from each of the groups, namely six, 
made the subjects feel that six were 
enough, and that they deliberated 
longer over the replies or wrote more 
slowly than the subjects of the S-group, 
who may have felt that they should 
answer as nearly the entire fifteen as 
possible. Or it might be that the in- 
clusion of painful areas, which is pos- 
sible from the fact that the X-form 
elicited replies to significantly more 
areas than the S-form, caused some 
blocking or resistance on the part of the 
subjects. 

Whatever the cause, or combination 
of causes, for the shorter X-form 
papers, the evidence is still not clear as 
to which is the better form for drawing 
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out significant material. Length of re- 
sponse alone is not a good criterion in 
this respect, and while it is a principle 
of projective techniques in general to 
touch upon as many conflict areas as 
possible, it is still conceivable that other 
factors could offset the advantage 
gained by so doing. Another principle 
of projective procedures is to allow 
maximum freedom of expression, and 
the weight of evidence in this direction 
seems to favor the S-form, in contrast 
to the greater conflict area coverage of 
the X-form. The conclusive answer to 
this question would have to be deter- 
mined by a validity study. 


Conflict area comparison between test 
and retest. It was thought that the re- 


liability between test and retest of the 4 
S-form might have been affected by a ~ 


difference in the conflict areas answered 


on the two sets of papers. To look into ~ 


the possibility of such a difference, a 
notation was made for each subject of 


the S-group as to which conflict areas — 


she answered on the test and again on 
the retest. (As in the other counts of 





x 


sy 


which or how many conflict areas were — 


answered, no differentiation was made 
as to the number of questions chosen 
under the area.) Fifteen subjects an- 
swered on the retest all of the same 
areas which they had answered on the 
original test, in some cases with the 
addition on the retest of one or more 
areas. The remaining ten subjects 
omitted on the retest some of the areas 


answered on the original test: of these — 











Tas_e 2. Difference in mean number of questions answered by S- and X-groups 
(original tests) 
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. TABLE 3. Difference in mean number of conflict areas answered on original test and 

a retest of S-group 

E Mean no. 

3 conflict o o 

4 Test areas o mean Diff. diff. C.R. 

3 Orig. 5.08 89 18 

: Retest 5.28 79 * 16 20 24 83 





ten, four answered an equal number on 
the retest, three answered more, and 
three answered fewer. The group 
means for number of areas answered 
on test and retest are approximately 
the same, 5.08 and 5.28 respectively. 
(See Table 3.) It cannot be concluded 
from these findings, either in com- 


for the average judge in the categoriza- 
tion of phrases to be .810, and in agree- 
ment of quartile placement to be .762. 
Because Sargent’s bases for inter-judge 
comparison are rather different from 


TABLE 4. Coefficients of correlation between 
scorer A and scorer B on X-form 
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difference in the conflict areas 


swered. 


an- 


Investigation of revised form of scor- 
ing. 

Reliability of scoring system. Using 
the scores of Scorer A and Scorer B 
on.the original papers of the X-test, 
correlation coefficients were computed 
for each of the four scoring classifica- 
tions. (See Table 4.) The Interpre- 
tation and Effect classifications show 
no significant relationship; the scores 
on Approach correlate + .40, signifi- 
cant at the 5 per cent level of confi- 
dence; those on Solution correlate 
+ 49, significant at the 2 per cent 
level. Sargent studied  inter-judge 
agreement in the categorization of 
phrases taken out of context, and 
again in quartile placement of -ten 
subjects on the basis of four ques- 
tions from each paper. Her re- 
sults show the contingency coefficient 





the basis for comparison in the present 
study, her results cannot be directly 
compared with these correlations. It 
may be noted that on the basis of quar- 
tile agreement, Sargent’s judges all 
agreed better on the patients’ papers 
than on the students’, so that average 
agreement on the basis of students’ 
papers, which would be more nearly 
comparable to the present study where 
of course students alone were used, 
would be lower than the figure she ob- 
tained from a mixed group. 

A possible reason for the insignifi- 
cant correlation found in the Effect 
classification may be the fact that the 
two categories under this head, Ten- 
sion-reducing and Non-tension-reduc- 
ing, really lie along a continuum instead 
of being opposed as are the pairs of 
categories under the other three clas- 
sifications. Few replies lie at either ex- 
treme of tension-reduction, with many 











TABLE 5. Coefficients of correlation between 
test and retest on X-form (scorer A) 











Classification r p 

Interpretation ............. +.16 >.10 
pS erry ee eee Pe +.46 <.02 
NE 2c ik ween ukinne Cece —.18 >.10 
DE ea Nv aetacnnd dnccine +.14 >.10 





in the middle where scorers might have 
difficulty in agreeing with one another 
as to the amount to be considered as 
reducing tension “to a considerable de- 
gree”’ (definition of Tension-reducing ) 
rather than “slightly” (definition of 
Non-tension-reducing.) It is conceiv- 
able that this differentiation is not suf- 
ficiently clear-cut, as defined, to allow 
for close agreement. Another difficulty 
in the Effect classification lies in the 
replies, repeatedly found in_ these 
papers, where the subject will postulate 
dissatisfaction immediately after the 
statement of the solution, and follow 
with a rather indefinite prediction of 
future satisfaction. This matter is 
taken up in the scoring directions and 
attention called to the fact that subjects 
are apt to rationalize in order to make 
their replies sound well. The test di- 
rections imply that the subjects should 
show insight into other people, and 
consequently they might feel a neces- 
sity to solve the problems satisfactorily. 
However, in actual scoring it is not 
always easy to decide when the pre- 
diction of future satisfaction is the re- 
sult of rationalizing an otherwise non- 
tension-reducing reply and when such 
satisfactions do actually constitute ten- 
sion-reduction for the subject. 

The insignificant correlation in the 
Interpretation classification cannot be 
explained on the grounds of possible 
overlapping of categories as in the 
Effect area; however, it seems from in- 
spection of these papers that it is more 
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common to have both categories stated 
under a given reply on the Interpreta- 
tion than for both categories to appear 
at once on the other classifications. 
Since the scoring system is based on 
the necessity of giving preference to 
the more definitely expressed category, 
it is possible that scorers, in failing to 
agree on this differentiation, might 
thereby cause divergence in their re- 
sults. 


Reliability of test. The scores of Scorer 
A on test and retest were correlated, re- 
sulting in an r of + .46 for the scores 
in Approach, significant at the 2 per 
cent level (see Table 5). Correla- 
tions between scores on test and retest 
for the other three classifications do not 
differ significantly from zero. A num- 
ber of reasons may be postulated for 
this. In the first place, any test-retest 
reliability on a projective technique is 
open to the criticism that the subject's 
personality manifestations may change 
in the time elapsing between tests. Be- 
yond this, the low reliability in the In- 
terpretation and Effect scores could be 
due to the unreliability of the scoring 
system in these areas. A third possible 
reason for low test-retest reliability in 
this particular set-up lies in the fact 
that although practically all of the sub- 
jects answered all six conflict areas on 
both test and retest, they did not neces- 
sarily answer the same questions on 
both, and equivalence between test and 
retest must rest on the assumption that 
all questions are equally neutral as re- 
gards the provoking of response cate- 
gories. Sargent felt that under her 


scoring system the armatures were not 
thus equal, but that some of them 
tended to elicit certain categories of 
response more frequently than chance 
alone would dictate. 
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Ouestion-pull. Sargent’s premise of 
lack of equality of armatures seems to 
apply also to the experimental scoring 
system of this study. This differential 
power amongst the questions to influ- 
ence or “pull” the answer in a certain 
direction has been termed ‘‘question- 
pull.” Because of the freedom of choice 
allowed the subjects and the conse- 
quently few answers to some of the in- 
dividual questions, the data were not 
complete enough to warrant statistical 
analysis. However, the three scorings 
on the X-test were pooled (original test 
by Scorer A and Scorer B, retest by 
Scorer A), and the total scores under 
the respective categories indicated. 
From inspection of these data, it ap- 
pears that on the basis of this set-up 
and these scorers, there is a definite 
tendency for most Approach to be Ac- 
tive and for most Solution to be At- 
tack. A reversal of this trend is found 
in question 8 which is scored predomi- 
nantly in the Escape category of Solu- 
tion. It is interesting to note that Sar- 
gent’s weights show this question giv- 
ing the. maximum deviation from aver- 
age expectancy on expressions of es- 
cape. Question 8 is scored in this ex- 
perimental system a markedly non-ten- 
sion-reducing compared to the other 
questions; Sargent’s weights, again, 
give it a maximum deviation in depres- 
sion. While it is not possible to carry 
comparisons with Sargent’s findings 
very far because of the difference be- 
tween the terms of scoring in the two 
systems, it is worth noting that her as- 
sumption of lack of equality of arma- 
tures is borne out in this study. If 
certain questions should prove to have 
significant pulling power, this might be 
taken into account by weighting in 
something the same manner as Sargent 
has done. There is also the possibility 








TABLE 6. 
tions, original X-test, scorer A 


Intercorrelations between classifica- 








Classification r p 





Intra-personal interpretation 


and active approach ...... +.21 >.10 
Intra-personal interpretation 

and attack solution....... +.48 <.02 
Intra-personal interpretation 

and tension-reducing effect +.49 <.02 
Active approach and attack 

ne ik eS. +.08 >.10 
Active approach and tension- 

reducing effect ........... —.09 >.10 
Attack solution and 

tension-reducing effect ... +.51 <.01 





of shortening the test and omitting the 
questions with the greatest pull. By do- 
ing this, perhaps the choices on the X- 
form could be made equal, or more 
nearly so, in number as well as in pull, 
amongst the several conflict areas. Un- 
doubtedly more information is needed 
concerning question-pull, for until the 
matter is determined more definitely, 
any quantitative work with conflict 
areas which allow a choice of arma- 
tures will suffer from the fact that, as 
far as can be judged at present, the 
pulling power of questions is not equal. 
Scores of subjects choosing different 
questions under the same area may re- 
lect this inequality of the questions 
and thus confuse the evaluation of dif- 
ferences between the subjects them- 
selves. 


Intercorrelations between — classifica- 
tions. In order to evaluate the experi- 
mental scoring system further, and to 
study the interrelationships of the be- 
havior represented in the replies, the 
scores of each pair of classifications 
were correlated, using Scorer A’s re- 
sults on the original test (see Table 
6). Positive relationships are shown 


between Intra-personal Interpretation 
and Attack Solution; between 


Intra- 
























personal Interpretation and Tension- 
reducing Effect; and between Attack 
Solution and Tension-reducing Effect. 
The correlations of Approach scores 
with all those of the other three clas- 
sifications are not significantly differ- 
ent from zero. 

In evaluating these correlations, it is 
necessary to take into account the re- 
liability of the scoring system, which 
was not high in any classification and 
was insignificant in some. From the 
figures as they stand, however, it is 
evident that the scores on Interpreta- 
tion, Solution, and Effect all intercor- 
relate to a fairly high degree, although 
the relationship is not pronounced 
enough to justify discarding any of 
these measures as superfluous in ob- 
taining an evaluation of personality. 
Approach is definitely measuring some- 
thing different from any of the other 
classifications, as evidenced by very low 
correlations with all three. From the 


behavioral standpoint, it appears from 


these findings that a person who in- 
terprets a problem of this sort as intra- 
personal will be more likely than not to 
reach a solution which has the charac- 
ter of attack, and which will have a 
tension-reducing effect. There is no 
evidence that there is anything in the 
choice of an active or a passive ap- 
proach which will predict, or which can 
be predicted by, the individual’s han- 
dling of the other aspects of the prob- 
lem situation which have been dealt 
with in this scoring system. 


SUMMARY AND CONCLUSIONS 


An experimental form of the Sar- 
gent test has been devised whereby the 
subjects are led to answer as many con- 
flict areas as possible instead of being 
allowed complete freedom of choice. 
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The test was administered in both 
original and experimental forms to two 
groups of college women. The results 
were studied as to the reliability of the 
original Sargent test, as to various as- 
pects of a new and simpler scoring sys- 
tem, and as to the relative merits of 
the original and revised forms of pres- 
entation of the test. 

The conclusions from this work are 
as follows: 

1. The test-retest reliabilty of the 
Sargent test on the basis of the F/C 
quotient is reasonably high for a pro- 
jective technique, but the time and la- 
bor are considerable for the broad 
group differentiation yielded by this 
score. 

2. The experimental form of admin- 
istration gives a_ significantly larger 
sampling of conflict areas, while the 
original form gives a_ significantly 
larger number of questions in the re- 
plies. Thus some evidence is presented 
for the advantage of each form as re- 
gards the drawing out of significant 
material. A validity study would be 
needed to settle this point definitely. 

3. There is no evidence that the lack 
of a higher reliability figure for the 
Sargent test is due to any difference on 
the conflict areas answered on test and 
retest respectively. 

4. Both this study and Sargent’s in- 
dicate that there is a definite tendency 
for certain armatures to have unusual 
provocative power as regards the re- 
sponse categories. Individual questions 
show tendencies to be scored in cate- 
gories that differ from group trends. 
If such inequality exists, it can be com- 
pensated for either by weighting or by 
the elimination of the most unequal 
items. If the questions with unusual 
“pull” are retained, then any individual 
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deviation from that should probably be 
considered significant. Until the matter 
of “question-pull” is more definitely 
settled, any quantitative work involving 
conflict areas which allow a choice of 
questions becomes less meaningful 
through the fact that all questions are 
very likely not equal as regards the 
provoking of response categories. 

5. The reliability of the experi- 
mental scoring system, investigated 
through the work of two independent 
scorers, shows significant and mod- 
erately high correlations in the classifi- 
cations of Approach and Solution, and 
insignificant correlations in the I[nter- 
pretation and Effect classifications. 

6. Test-retest reliability in the ex- 
perimental form shows a_ significant 
correlation in Approach classification 
scores only. The low correlations in 
the other classifications may be due to 
the fact that the subject’s reaction pat- 
terns may have changed during the in- 
terval between test and retest; in the 
Interpretation and Effect clasgifications 
they may be due to the unreliability of 
the scoring system in these areas. In 
this particular set-up of administration, 
as mentioned under (4), the added 
complication of the undetermined 
“pulling” power of the various ques- 
tions may have been a factor in re- 
ducing test-retest reliability, since the 
subjects did not necessarily answer the 
same questions on the two tests. 

7. Intercorrelations between the 
scores of the four classifications of the 
experimental scoring system show sig- 
nificant relationships between Interpre- 
tation and Solution, Interpretation and 
Effect, and Solution and Effect. Ap- 
proach is measuring something dif- 
ferent from the other three; it is fur- 
thermore the only classification to show 
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significant reliability on both scorer-vs.- 
scorer and test-retest comparisons. 

8. In the matter of behavioral tend- 
encies and relationships, there is, on the 
basis of this set-up and these scorers, a 
marked tendency for most problems to 
be handled by an active rather than a 
passive approach, and for the solution 
to be attack rather than escape. The 
general pattern of reaction to problem 
situations of the kind presented is, for 
these papers, an intra-personal inter- 
pretation, a solution of attack, and a 
tension-reducing effect. There no 
evidence that the choice of an active or 
a passive approach to such problems 
will determine the person’s reaction in 
the other fields which have been studied 
under this system of evaluation. 

With regard to the determination of 
reliability of the experimental scoring 
system, it might prove a better method 
to try out a slightly more differentiative 
modification than the all-or-none evalu- 
ation which was used in this study. 
Both categories could be scored when 
both are expressed, and rated on a 
three point scale of slight, moderate, or 
marked. The final scores could be ex- 
pressed in percentages as they have 
been in the present experiment so that 
the results would be directly com- 
parable. It is possible that correlations 
computed on these scores would prove 
higher than on the scores used in the 
present study. 

Neither this study nor Sargent’s was 
concerned with validity, and Sargent 
states that with her scoring system un- 
revised, a validity study is not indi- 
cated. However with the experimental 
system of this study being briefer and 
easier to handle, it would be well to 
undertake some validation procedure 
befere any extended work is done with 
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reliability. Efforts to raise the re- 
liability of the test itself or of any sys- 
tem of scoring it will be fruitless un- 
less the validity is high enough to 
demonstrate the usefulness of the Sar- 
gent test as a diagnostic tool. 

From a general consideration of all 
the aspects studied, it seems that the 
experimental scoring system developed 
and tried out in the present study has 
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potential value as a clinical device, and 
would merit further investigations. 
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RECENT ADVANCES IN SCREENING THE EMOTIONALLY 
MALADJUSTED* 


JOSEPH ZUBIN 


New York State Psychiatric Institute, Columbia University 


Toward the end of World War I 
(July 1918) Pershing cabled the Chief 
of Staff: “Prevalence of mental dis- 
orders in replacement troops recently re- 
ceived suggests urgent importance of in- 
tensive efforts in eliminating the men- 
tally unfit from organizations new draft 
prior to departure from United States” 
(10). Psychologists had not been un- 
aware of the problem and early in the 
war (April 25, 1917) Woodworth had 


_ been appointed by the American Psy- 


chological Association as chairman of a 
committee on Emotional Fitness for 
Warfare. Woodworth and _ Poffen- 
berger worked assiduously on this prob- 
lem at Columbia and after trying out 
various tests “hit upon the idea of as- 
sembling minor neurotic symptoms, as 
found by psychiatrists in the case his- 
tories of individuals who later developed 
neuroses or psychoses, and tallying up 
the score of positive answers’’(18). The 
impetus probably afforded by Pershing’s 


* Read before the meeting of the New York 
State Association of Applied Psychology, Feb- 
ruary 1, 1947. 





cable led to immediate tryouts of the 
test which eventually became known as 
the Woodworth Personal Data Sheet, 
the first screening device to be used by 
our military forces. The Personal Data 
Sheet “was intended as a screening de- 
vice with primary use of the quantita- 
tive score, but also with attention to cer- 
tain ‘starred questions’ which the psy- 
chiatrists in the conference believed 
would be of significance quite apart 
from the total score’ (18). The Personal 
Data Sheet went through two major re- 
visions before it was finally authorized 
by the Surgeon General for a really in- 
tensive tryout in the Army; and by that 
time, about October 1, 1918, the war 
was nearly over. 

In the postwar period the untried 
method was used widely in schools and 
industry with inconclusive results. The 
advent of World War II found a group 
of men already engaged in experiment- 
ing with screening inventories and soon 
after Pearl Harbor wide use of such 
tests was made in the navy, merchant 
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marine, and to a lesser extent in the 
army. While it would perhaps not be 
easy to demonstrate that screening 
shortened the war and reduced casual- 
ties, it would be difficult to avoid such a 
conclusion. To be sure, screening did 
not prevent mental breakdowns from 
occurring in the ranks, both here and 
abroad, but the number of such occur- 
rences, though large and in some in- 
stances appalling, would probably have 
been even more staggering if the initial 
screening had been omitted. 

The success of these devices was so 
phenomenal that some of the older psy- 
chologists who lived through the defla- 
tion of the psychoneurotic inventories 
during the 30’s found it difficult to be- 
lieve that these tests could be 85 per cent 
efficient. Certainly, the tests were not 
perfect, many false positives being un- 
necessarily caught in the screening net 
and some false negatives slipping by. 
Nevertheless the screening technique 
was a success. Although the final count 
is not complete, it seems reasonably safe 
to conclude that screening tests, under 
favorable conditions, will detect the 
great majority of the patently malad- 
justed. They will not, however, per- 
form miracles. For example, they will 
fail to predict the development of a 
schizophrenic psychosis before any 
traces of the disease onset are apparent ; 
nor will they predict the amount of 
stress a given soldier, normal at induc- 
tion, can withstand before reaching his 
breaking point. Indeed, the problem of 
predicting the breaking point under 
stress has become the number one prob- 
lem of screening of the future, and thus 
far the experimentation with miniature 
stress situations has not been too suc- 
cessful. A very readable description of 
this problem, as observed during World 
War II, is given by Brigadier General 
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Cooke in a recent volume entitled “All 
But Me and Thee’’(2). 

It is difficult to fathom why the psy- 
choneurotic inventories worked so well 
during the war but not at all during the 
peace. Several factors have probably 
been responsible. First, we developed 
better instruments. Second, the general 
population became better acquainted 
with such diagnostically meaningful 
terms as epilepsy, convulsions, mental 
hospitals and psychiatrists ; and mental- 
hygiene education percolated far enough 
to permit people to admit headaches, 
dizzy spells; nausea, vists to a psychia- 
trist or a mental hygiene clinic, etc., 
without fear of being labeled insane or 
mentally deficient. Third, the feeble- 
minded were more readily caught by 
suitable intelligence screening tests and 
were thus separated more readily from 
the emotionally unfit. Fourth, some- 
how the average recruit seemed to be 
able to confide more in his examiner 
than the average peacetime sophomore 
in his college professor. Fifth, the total 
score was supplemented with the “stop 
item’ device, which Woodworth’s com- 
mittee had designated as “starred 
items,” to catch in the screening net in- 
dividuals who, though generally pre- 
senting an adjusted picture, had under- 
gone some psychologically notable ex- 
perience, such as a severe head injury, 
enuresis, hospitalization for mental ill- 
ness, incarceration, multiple arrests, etc. 
Anyone who gave evidence of such psy- 
chological deviation was placed in the 
“suspected” group no matter how nor- 
mal he appeared otherwise. 

But perhaps the most important fac- 
tor was the lower level of aspiration 
which these inventories adopted. They 
were, from their very beginning in 
World War I, not regarded as person- 


ality tests; they were merely sieves 











separating the recruits into two groups 
—those who had to be screened further 
by a clinician in a short personal inter- 
view and those who needed no further 
screening. This modest claim is due to 
the trend set by Woodworth and his 
1918 committee who stated that “The 
questionary should be administered by 
the Psychological Examiners of a camp, 
being given to groups of recruits along 
with their group mental test, and being 
scored by the psychologists and the re- 
sults, so far as significant for the neuro- 
psychiatrists, being then submitted to 
them’’(19). Establishing the normality 
of about two thirds of the candidates 
without calling upon the time of the 
clinicians permitted the very small num- 
ber of available clinicians to devote their 
energies to the one third who actually 
needed attention. 

As an example of the efficacy of the 
screening procedure, the experience of 
the U. S. Maritime Training Station at 
Sheepshead Bay might be cited(8). Out 
of every 1,000 men processed, 660 re- 
quired no further interview after their 
screening questionnaire was scored. The 
remaining 340 were given the brief fol- 
low-up screening interview because they 
either had a deviant score or some 
“stop” item on their record. Of the 
340 interviewees, 15 had to be dis- 
charged from the service, 75 were found 
to have temporary or mild emotional 
conditions which required short-term 
therapy, while the remaining 250 indi- 
viduals were false positives. In this 
way, by seeing 250 false positives per 
1,000 admissions, it was possible to de- 
tect fully 85 per cent of the totally un- 
fit and select the men who could be re- 
claimed for the service after brief-term 
therapy. The 660 men who passed 
through the screening as normal con- 
tained in their number three who were 
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subsequently disenrolled from training 
for emotional reasons. Of these, one 
had passed through the screening sieve 
because he was apparently normal at the 
time of the screening and did not be- 
come mentally ill until later, while two 
had passed the screening sieve by dis- 
simulating their symptoms. Thus, 18 
individuals in every 1,000 were disen- 
rolled on emotional grounds, and 15 of 
these 18 were discovered during the 
screening test. The data given above do 
not include those who eventually broke 
down during the course of service. 

The outstanding advantage of this 
screening procedure is that the screening 
load can be adjusted to the capacity of 
the screening personnel available. This 
is done by raising or lowering the criti- 
cal cut-off score, on the basis of which 
men are selected for interview. A series 
of controlled experiments have indicated 
the proportion of the total number of 
candidates that fall above each cut-off 
point, as well as the rates for false posi- 
tives and false negatives that correspond 
to each cut-off point. This flexibility of 
the technique permitted each station to 
adjust its load to any degree of accuracy 
desired. 

Whether the personality inventories 
born of the war will find use in peace is 
still a moot question. The emergency 
nature of screening tests should be 
borne in mind. Beginning with the 
Biblical screening test administered by 
Gideon before his battle with the Mid- 
ianites and ending with the most re- 
cent psychoneurotic inventory, screen- 
ing tests have come in response to some 
emergency, only to be discarded when 
the emergency is past. Will the fate of 
the present tests be different? The pros- 
pects of continued usefulness seem 
brighter now, especially if suitable al- 
lowances are made in the tests for the 
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transition from war to peace uses. It 
must be recognized, for example, as 
Hunt(6) has so well pointed out, that 
the very items which proved so diagnos- 
tic in wartime—dizzy spells, convul- 
sions, headaches, homosexuality — do 
not have as close a bearing on success 
in civilian life as they do in military life. 
Many a successful employee may have 
some of these symptoms and yet be 
highly efficient in his civilian occupa- 
tion. There may be other items which 
would be just as crucial to peacetime 
success as those “‘stop’’ items were for 
military success. 

Furthermore, although the war emer- 
gency is past, we now find ourselves in 
a new type of emergency. Industry is 
demanding more efficient methods of 
selection ; school and community clinics 
require more efficient methods of in- 
take, diagnosis, classification and eval- 
uation. This is not said in disparage- 
ment of the methods now in operation. 
These methods were keyed to the small- 
er demands of the prewar and war 
periods. They were never intended to 
satisfy the large scale demand that has 
arisen. That the training of more per- 
sonnel alone is not a sufficient answer 
} can readily be seen by noting how rap- 
idly the demand is outstripping the 
supply. While the demand increases 
geometrically with the opening of each 
clinic, the supply of personnel trickles 
in arithmetically from the training 
schools. Group screening techniques 
have again become a necessity, but a 
new type of screening is required. The 
men coming to the clinics have already 
passed one screen; they have come for 
help. The task now is to classifiy the 
applicants with regard to the types of 
help required. 

The personality inventory in its pres- 
ent form is not suitable for this pur- 
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pose, since it was devised for differ- 
entiating normals from deviants and 
not for differentiating within the de- 
viant group. For this purpose we need 
new groups of tests. What should be 
the nature of these tests? A good start- 
ing point would be tests of the word 
association type, the projective type, 
expressive movement type, and tests of 
abstraction of the Shipley Hartford Re- 
treat(12) type, etc. Psychoneurotic in- 
ventories of the Minnesota Multi- 
phasic(7) variety can perhaps prove 
useful. But too often in the past it has 
been found that this type of test is sub- 
ject to inexplicable variation from sam- 
ple to sample. Perhaps a question of 
semantics is involved here. I recall the 
difficulty we experienced in eliciting in- 
formation about enuresis. The for- 
mula which seemed to work best was: 
“Did you ever have weak kidneys?” 
Whether this formula would work in all 
regions equally well is very doubtful. 
An inventory couched in Basic English, 
as Landis has proposed, might perhaps 
be the answer. 

It may be noted in passing that the 
material of nearly all of these tests had 
at one time been used for measuring in- * 
telligence or achievement. Inkblots had 
been used by Binet(1) for measuring 
intelligence and imagination; pictures 
of the TAT type had been used by 
Binet(1) as intelligence test material and 
by Stern(13) and others as tests of 
testimony (Aussage) ; incomplete sen- 
tences had been used by Ebbinghaus(3) 
for measuring intelligence; and hand- 
writing scales had been used by Thorn- 
dike(16) for measuring achievement in 
learning to write. In adapting this 
material to personality measurement, it 
had to be freed of the restrictions im- 
posed by the requirements of right and 
wrong answers. In the process, objec- 








tivity of scoring had to be sacrificed. 
Before these materials can be used for 
group screening, some rigor and speci- 
ficity must be reintroduced. But this 
rigor and specificity will be based on the 
rich experience which the liberated ma- 
terial has accumulated during the past 
few decades. 

Recent developments in the word as- 
sociation test by Goodenough(4) (who 
utilizes homonyms ) and by Tendler(14) 
(who has developed certain indexes fo1 
distinguishing neurotic from psychotic 
performance) are good examples of the 
new type of screening test required. 
Perhaps multiple choice forms similar 
to those suggested by Maller(9) and by 
Thurstone(15) can be readily adapted 
to group screening. 

In the projective field the incomplete 
sentence test, the Levy Movement 
Cards(20), the Tomkins-Horn Picture 
Arrangement(17) test, the Rosenzweig 
PF test(11) and the Franck Sex Sym- 
bolism Test(5) are examples. The chief 
difference between these tests and their 
classical prototypes inheres in the fact 
that the new tests are more controlled 
and the tasks they set before the sub- 
ject more specific. Indeed, it is quite 
likely that the utilization of these more 
specific tests may help reduce the more 
imponderable tests, like the Rorschach 
and TAT, to more manageable propor- 
tions psychometrically. As an exam- 
ple of what can be achieved, we can look 
at the Levy Movement Cards. 

The patients are told that they are 
to be presented with cards showing 
people in movement. Even with this 
dead give-away of the purpose of the 
test, some individuals reject the cards, 
others see only inanimate objects. Psy- 
chometric scoring scales have been de- 
vised for these cards which are reason- 
ably objective and which have already 
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proved their diagnostic worth empiri- 
cally in contrasted groups of normals, 
neurotics and schizophrenics. It can 
be readily seen that the other factors 
of the Rorschach test can be similarly 
treated in separate tests and similar pro- 
cedures developed for color, form and 
shading responses. Another feature 
that Levy has added to his cards is a 
phantasy test in which, at the comple- 
tion of the initial task, the patients are 
asked to write a short story about the 
people they had seen in movement. This 
adaptation of the TAT technique to 
Rorschach material seems to be a most 
fortunate approach, since it deals en- 
tirely with pure projective material un- 
encumbered with the controls imposed 
by structured TAT cards. 

In the field of expressive movement 
certain outstanding handwriting char- 
acteristics, which can be secured from 
handwriting specimens obtained in the 
course of the group testing, may prove 
to be useful in the preliminary diag- 
nosis. 

How are these tests to be used? 
After the applicant has been given his 
battery of group tests, he is either sent 
home to return in a day or so, or, if 
enough clerical and machine scoring 
aids are available, his record can_ be 
processed immediately and_ presented 
within a half hour or so to the senior 
psychologist for study. Armed with 
the salient facts of the standard battery, 


the psychiatrist or psychologist can ~ 
proceed either with individual or group 4 


interviews, group therapy techniques, 
further tests or other approaches in ac- 


cordance with the obtained results. It | 
is, of course, a program which cannot © 
be launched immediately. Considerable © 
‘time and effort will be required for — 
obtaining norms and standardization of | 
the selected battery, but such time would — 
























































be well spent since it will eventually re- 
duce the diagnostic load and provide 
more time for therapy. In this way 
the mass wartime screening procedures 
can be transformed to detecting the 
areas of the individual which require 
attention. 

An additional source of information 
which might prove of considerable diag- 
nostic value in the case of veterans is 
the previous record of the patient. If 
the service data could be made available 
to each clinic in a master file of IBM 
cards, much significant material bear- 
ing on diagnoses could be obtained. 
Perhaps a teletype system in central 
headquarters could feed such informa- 
tion to outlying clinics. Care should be 
taken, however, not to let the history 
alone determine the type of therapy and 
treatment to be given. 

Besides the administrative usefulness 
of such screening procedures in increas- 
ing the amount of time available for 
‘therapy, other virtues inhere in this ap- 
proach. It utilizes techniques which the 
novice can apply, and for a long time 
to come the bulk of our first interviews 
will perforce be in the hands of novices. 
It will permit the trainee to advance, as 
he gains more skill, from routine ad- 
ministration of group tests to more 
skill-requiring administration of inter- 
views, individual tests, and finally to 
evaluation of the total record of a pa- 
tient and the making of diagnoses and 
carrying out of recommended therapy. 

The standard battery will also pro- 
vide standard research data on the qual- 
ity of intake and, if the tests are re- 
peated before discharge, on the particu- 
lar type of test improvement noted. In 
this way both the caliber of the therapy 
as well as of the tests can be improved 
in a demonstrable, objective manner. 
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The values involved in such a pro- 
gram cannot be preserved if the stand- 
ard battery is permitted to crystallize at 
a given level and to be maintained by 
sheer inertia from then on. To avoid 
such a contingency it is necessary to 
expand the team of psychiatrist-psy- 
chologist-social worker by the addition 
of a research-minded person, be he so- 
cial worker, psychiatrist or psycholo- 
gist. His clinical load must be such 
that he will not be swamped by the 
regular demands of the clinic, but will 
have time and opportunity to maintain a 
running survey of the efficacy of each 
of the instruments and revise them as 
need arises. Without such a worker spe- 
cially delegated to this task, the screen- 
ing program cannot succeed. The pri- 
mary task of this research person will 
be to provide the proper integrating de- 
vice for encompassing the findings on 
the various tests. Total scores have 
long passed their zenith in psychomet- 
rics. Pattern analysis, profiles and 
various other devices will have to be 
invented, which are simple in their ap- 
plication yet significant and trenchant 
in their meaning for classification and 
understanding of the patient. 

It might be argued that the clinic pa- 
tient coming for help will shy away 
from all of these screening devices and 
will consider them either as an affront 
to his dignity or as irrelevant to his 
problem. Such may be the case in a 
small proportion; but we must remem- 
ber the long waiting lines in front of 
our clinics, the fretful idling away of 
time in the waiting room for the person 
who is already worried and anxious. 
If certain hours could be established as 
intake hours, at which time all newcom- 
ers would be seated and given an orien- 
tation talk indicating that this is the 
beginning of their medical examination, 








few if any would refuse to cooperate. 
There is no one more ready than a neu- 
rotic to tell his troubles even to a ques- 
tionnaire or to become absorbed in a 
test which may tell something about 
him. This screening technique might 
prove even more helpful in medical and 
surgical clinics, since a large proportion 
of somatic complaints are usually found 
associated with mental symptoms. 

What degree of success can be ex- 
pected from such procedures? We can- 
not hepe to be as successful in our diag- 
nostic group screening as we were in 
wartime screening. The military de- 
mands are specified and one can build 
tests to meet the specifications. Mal- 
adjustment in life is more complex and 
criteria or goals of adjustment more 
diffuse. Furthermore, the accepted 
psychological and psychiatric diagnos- 
tic categories are not too helpful. Per- 
haps new goals will have to be estab- 
lished; not diagnostic goals, but thera- 
peutic goals. Tests can perhaps succeed 
in indicating to what type of therapy a 
given patient will respond. Then the 
screening procedures will have attained 
their ultimate goal, since diagnosis, to 
be useful, is merely a_ preliminary 
screening out of the undesirable thera- 
pies and a selection of the desirable one. 

In conclusion, screening procedures 


for segregating the emotional deviant 
‘from the normal are now a fait accom- 


pli. World War II has provided the 
crucible for testing their efficiency and 
they have successfully met the test. The 
next step in screening is to identify 
within the maladjusted individual his 
particular areas of difficulty. This is 
not a mere academic desire ; it is a prac- 
tical necessity, since without such pre- 
liminary diagnostic screening our pres- 
ent method of handling patients is 
bound to break down, even as selection 
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in the draft and armed services would 
have broken down in the absence of 
screening. New techniques are required 
combining the simpler factors involved 
in questionnaires, projective techniques, 
expressive movements, abstraction tests, 
etc., which can be readily adapted to 
group use. The provision of such tests 


~will save the time of the patient and 


professional staff, will permit more time 
for therapy, will provide the trainee 
with a series of graded diagnostic tasks 
suited to his growing ability, and will 
provide an objective standard record of 
the status of a patient on admission and 
at discharge. In order to carry out such 
diagnostic screening, a new member 
must be added to the triumvirate of psy- 
chologist-psychiatrist-social worker in 
the mental hygiene clinic—z1z., the re- 
search-minded clinician. 
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INTRODUCTION 


The purpose of this investigation 
was to ascertain the ability of the Cor- 
nell Index, form N3, to indicate the 
personality differences existing in a 
hospitalized tuberculous group as com- 
pared with a non-hospitalized college 
sample. The Cornell Index was se- 
lected because of its nature and because 
its brevity and simplicity does not tax 
the patient. The 62 questions of the 
test are grouped according to symptom 
complexes in order to facilitate clinical 
interpretation (see table 1). 


PROCEDURE 


The plan of this experiment was to 
compare the results obtained from the 


* The writers are greatly indebted to Frank 
M. du Mas for his invaluable advice and as- 
sistance. Mrs. Wechsberg was clinical psy- 
chologist and Dr. Sparer was Medical Director 
and Superintendent. 
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Cornell Index using a control group of 
college freshmen taking psychology 
courses at the University of Denver 
and an experimental group of tubercu- 
lous patients at the J.C.R.S. Sana- 
torium. The tuberculous patients were 
given the C.1., N3 as part of a routine 
examination by the clinical psycholo- 
gist following the standard administra- 











TABLE 1. Symptom categories of the Cornell 
index 

Question 

Nos. 

(F) Fear and Inadequacy .............. 2-13 
Cy Deere snes ka 1,14, 15 
coe | SO ee ree 16-21 
(N) Neurocirculatory ................. 22-26 
re 27-29 
(Ps) Psychosomatics .................- 30-40 
(H) Hypochrondriasis ................ 41-43 
(G) Gastrointestinal ................... 44-48 
Caer NII oa Fad ck so ns cee pin as ee 49-52 
(P) Troublesome Psychopathy ......... 53-62 
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tion technique described by the authors 
of the C.I.(11) 


Subjects. The normal group (N) con- 
sisted of 100 college freshmen, 75 
males and 25 females ranging in age 
from 18 to 32 years. The tuberculous 
group (T) consisted of 100 hospi- 
talized patients, 60 males and 40 fe- 
males ranging in age from 16 to 67 
years. 


Methods of Analysis. In addition to 
standard statistical methods, a newly 
devised profile technique was used to 
effect a more dynamic comparison be- 
tween groups N and T. Recent writers 
(7,8,9) have stressed the importance of 
profiles rather than unorganized scores 
in the interpretation of personality 
tests. A profile is actually a graphic 
depiction of performance on the sub- 
tests of any questionnaire. In the pres- 
ent study the adjacent score points are 
the 10 symptom categories that consti- 
tute the C.I. After du Mas’(3) dimen- 
sions of intensity and pattern, all pro- 
files in figs. 1, 2 and 3 were constructed 
from the C.I. group sub-scores con- 
verted into percentage scores according 
to the following formula: 
F 
Symptom Intensity> % essai ita xX 100 
Where: 
F = No. of items answered “yes” or “failed” 
by the group in a symptom category. 


N = No. of individuals in group. 
Q=No. of items in a given category. 
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100 = A constant used to convert ratio F int 


NQ 
equivalent percentage. 
% = Percentage score of items failed by th: 
group in the category. 


RESULTS 


The basic C.I. responses for the N 
group are given in table 2 and for the 
T group in table 3. The mean number 
of “Neurotic” responses was slight) 
higher for the tuberculous patients as 
compared with the normal group. For 
both groups, the means of the male and 
female neurotic answers show a wide 
disparity. In group T, the calculated 
critical ratio of 2.20 seems to indicate 
that the female patients tend to score 
significantly higher on neurotic items 
than males, but that no reliable dif- 
ference exists between their “Stop” 
scores (critical ratio .26). 

Since it was desirable to know what 
relationship existed between the age 
levels and C.I. score responses, r tetra- 
choric was computed for group T with 
results indicated in table 4. With a 
mean age value of 38 years for group 
T (Male mean, 41 years; female mean, 
32 years), and the highest total score 
of 21, no obtained r: was greater than 
.27 for male, female or total group T. 
The criteria of the fourfold table used 
in calculations were the mean age and 
mean score values of the groups; hence 
it can be stated that the two factors ot 
age and C.I. responses are not related 


TABLE 2. Means and standard deviations of basic C.J. responses of 100 “Normal” 
students (group N). 











Stop Neurotic S&N 
Maes eee s { Gey sere we Yo ae 
Eee Ss 3 2 75 5.73 4.93 75 607 5.32 
Female ...... a ee 25 5.96 5.25 25 612 5.58 


Male and 





female ..... ‘ p 100 


5.88 4.94 6.08 











= si . . 
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TABLE 3. 
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Means and standard deviations of basic C.l. responses of 100 tuberculous 
patients (group T). 











Stop 








Male and 
female ..... 








for the hospitalized tuberculous _pa- 
tient. However, correlating the dura- 
tion of hospitalization for each patient 
in months and years with his Index 
score appeared to be a more fecund 
possibility. The range of hospitaliza- 
tion was from one month to 11 years, 
with an average stay of 3 years. For 
male patients, with an obtained rm of 
.65, P.E. .07, there seems to be some 
predilection to show higher neurotic 
responses with longer hospitalization 
(see Table 4). This correlation is low, 
however, and does not permit general- 
izations to be made for clinical inter- 
pretations. 

The obtained critical ratio of .22 be- 
tween groups N and T on total scores 
gives no indication of a significant 
difference between their responses. In- 
spection of the sub-group profiles in 






TasLe 4. Tetrachoric coefficient of correlation for group T, C1. responses vs. length 
of hospitalization ° 


Neurotic S&WN 





fig. 1 emphasizes that female patients 
score higher than male in most symp- 
tom categories. 

A symptom analysis made between 
the two group profiles delineated in 
Figure 3 indicates for the most part 
that Group T has a predilection for 
greater score intensity (see Table 5). 
However, only the neurocirculatory 
symptoms yield a_ difference large 
enough for clinical interpretation. A 
chi square comparison for intensity was 
also made between the profiles of 
Groups T and N. Formula used was 5 
Goi in which fo is the subtest per- 


; 
centage score of Group T and f; is the 
subtest percentage score of Group 
N. It was found that X* = 17.865; 
P= .06. Guilford(5) categorizes a 
Pearson coefficient of P = .06 as repre- 
senting poor fit. 














N Responses 








r, P.E.¢, 





Neurotic ....... 
RO so Schnee 


Stop 


SOE CaN Ths 


WON ic ca caus 
Neurotic ....... 


Male and female 100 





Neurotic ...... 


SS ye i 09 





WER PSA SDE Mes AOE pete . 10 
Sb aap Rl Bay hint +.65 07 
jee wash ease +.65 07 
EAE FOG E rempee e positive* -— 

ae aa hip bys care RES positive* — 
5 Se ee age A +.24 ll 
Re roe cle aes, oe +.29 Jl 
See elie aioli + 33 .09 





* These r,’s were so small as not to be obtainable from Hayes’ tables (6). 
ever, fourfold plot indicated a very low positive value. 









How- 
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TABLE 5, Symptom analysis between groups N and T 








Symptom F D A N 


Sr Ps H G Ss P* 





Critical ratio ..  .22 87 1.22 2.83 56 .26 49 1.71 00 .00 





* See Table 1 for complete names of each symptom category. 


A pattern comparison between the 
male and female profiles in Figures 1 
and 2, and between the group profiles 
in Figure 3, yielded each an rps of 
+ .33. This coefficient is a recently de- 
veloped technique for comparing pat- 
terns(2). Therefore, the sub-group con- 
figurations within Groups T and N 
differ from each other to approximately 
the same degree as the two total group 
patterns differ from each other. Hence 
it appears that all the patterns are fairly 
similar on the whole. 

To obviate the use of the group for- 
mula for the individual profile, Table 6 
is proposed. The individual sub-score 
percentage is arrived at by locating the 
symptom classification on the abscissa 
and the number of items failed in that 
syndrome on the ordinate. The per- 
centage score, or intensity, is read off 
at the intersect and the corresponding 
points are plotted on the graph to give 


the individual pattern. Percentage 
scores are rounded off to the nearest 
‘ whole per cent. Needless to add, dis- 
cretion must be the keynote in using 
this technique for clinical interpreta- 
tion. 

Discussion 


This study has endeavored to indi- 
cate the efficiency of the Cornell Index 
“stop,” “neurotic’” and total items in 
terms of their diagnostic value for com- 
paring a hospitalized tuberculous group 
with a non-hospitalized sample of the 
college population. This approach, in- 
stead of the criterial scores indicated 
by the authors of the C.I. was used(11), 
If the length of hospitalization is at all 
indicative of the severity of tubercu- 
losis, and it is, then the psychosomatic 
concomitants are better reflected by the 
neurotic items than the stop (see Table 
4). This statement does not appear to 
be in agreement with the findings of 


TABLe 6. Technique for showing the individual percentage score profile 








Symptom Category* 
i ae ae Sa ey eee 


No. itemsfailed oF D A WN 








0 e: 9 0 0 
1 oS oa oe 
2 ial gee. 
3 25 100 SO 60 
4 33 a a 
5 42 om 83 100 
6 50 .. 100 

7 58 = iS 

8 67 

9 75 

10 83 

11 92 

12 100 


0 0 O 0 0 0 
33 > eee ©. aay. Sires.” 10 
67 18 67 40 SO 20 
1 27 108... 30 
36 .. 80 100 40 
45 Pe sa 50 
55 pee fa 60 
64 70 
73 80 
Be ey ue ae 90 
91 mee “yr ra 100 
100 





* See Table 1 for complete names of each symptom category. 
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Watson and Weinstock (19) who claim 
that whatever contribution the Index 
(form N) makes is by means of the 
stop items. Nevertheless, our approach 
is supported by the findings of du Mas 
(4), 
ticles used form N, the authors of the 
Cornell Index have noted that the 3 
forms; N, N2 and N3, are comparable 
(11). That neurotic items are_more dis- 
criminating is also substantiated by 
Table 3 in which female patients score 
higher than male patients, but which 
shows no significant difference between 
their stop scores. 















From a recent study on acute respira- 
tory diseases, the authors of the CI. 
infer that the portion of the population 
hospitalized for acute respiratory in- 
fections has a higher incidence of per- 
sonality disturbances than those not 
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Showing the Cornell Index Profiles of Tuberculous sub- and total groups. 


Although the writers of both ar- 
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hospitalized(1). Although it is evident 
that the hospitalized tuberculous pa- 
tients do score higher on the whole than 
our “normal” sample, the difference is 
not large enough to assume personality 
disturbances. However, we may point 
to the one factor that supports the 
validity of the test: Tuberculous pa- 
tients with a high incidence of neuro- 
circulatory disorders do score higher 
than our “normal” group on the neuro- 
circulatory sub-test. 

The group profile technique sug- 
gested may well serve a purpose in pat- 
terning other normal and select deviate 
samples of the population on the Cor- 
nell Index. However, although the pro- 
posed table from which individual - 
symptom responses can be converted to 
percentages may be an effective way of 
assaying the single case quickly, cir- 
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cumspection must be exercised in its 
clinical interpretation. The salient con- 
tribution of the profile technique in 
general is that it depicts the interrela- 
tionship of traits, and consequently, 
facilitates viewing behavior as a dy- 
namic pattern, not as a mathematical 
aggregation of scores. 


CONCLUSIONS 


1. On the whole, the Cornell Index, 
N3, does not seem to show personality 
differences existing in a_ hospitalized 
tuberculous group as compared with a 
“normal” non-hospitalized sample. 

2. Although the tuberculous group 
does tend to score higher, as evidenced 
from the statistical and profile analy- 
sis, there is no significant departure 
from the “normal” results, with the 
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exception of the neurocirculatory symp- 
toms. This appears to argue for the 
validity of the Cornell Index. 

3. The profile technique seems to 
have its greatest value in the study of 
large samples. The formula, % Score 
= F/NQ x 100, may be used effectively 
to plot the symptom intensities for 
groups on the Cornell Index; and the 3 
patterns that these points delineate ma) 
be compared by the rps coefficient. 

4. The profile in general allows sub- 
test performances to be evaluated in 
terms of integrated behavior patterns. 
However, when a single profile is con- 7 
structed from the devised table, caution } 
must be exercised in its interpretation. 7 

5. “Neurotic” items on the Cornel! 7 
Index appear to be more discriminating ~ 
than the “stop” questions in this study 
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Fic. 3. Showing the Cornell Index Profiles of the Tuberculous and “Normal” groups. 


6. Age is not significantly related to 
the C.l. scores for the tuberculous pa- 
tient, whereas the length of hospitaliza- 
tion has a low positive relationship with 
the neurotic scores of the male patient. 
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INTRODUCTION 


Suggestibility is a phenomenon so 
universally encountered in multiformed 
patterns that no system of psycho- 
therapy can be considered complete 
which does not deal effectively with its 
manifestations. Suggestion operates in 
such an indirect, subtle manner that 
the results of all psychotherapy must 
be critically evaluated in order to clearly 
identify the nature of all curative fac- 
tors. Clinical experience teaches that a 
large percentage of functional disorders 
are determined by suggestibility and are 
susceptible to treatments involving sug- 
gestion as a specific therapeutic agent. 
In fact, the effects of suggestion are so 
widely distributed in all behavior that 
they constitute a least common de- 
nominator against which the effects of 
other methods of therapy must be evalu- 
ated, i.e. therapeutic results should not 
be explained in terms of other factors 
until the effects of suggestion have 
been ruled out. Perhaps the most com- 
mon error in clinical practice has been 
to ascribe therapeutic results to other 
factors which are in reality determined 
by suggestion. 


Definitions. Suggestibility involves a 
more or less permanent susceptibility 
to a wide range of phenomena includ- 
ing heterosuggestion (direct and indi- 
rect), autosuggestion, hypnosis and the 
trance states. Suggestion may be de- 
fined either operationally or in terms of 
results. Operationally, suggestion is a 
process of communication in which one 


person attempts by use of stimuli, 
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of Vermont 


usually verbal in nature but exclusive 
of argument or direct command, to in- 
duce an idea, feeling, decision or action 
in another person by circumventing the 
critical, integrative functions. The pro- 
cedure is essentially that of presenting 
stimuli which build up attitudes, re- 
lease them, or augment the release of 
incipient responses, with a minimum of 
reflective thinking on the part of the 
individual to whom the suggestions 
are given(1). One of the results of 
suggestion is the establishment of a 
dominance-submission relationship — in 
which the submitting members of the 
group respond uncritically and without 
logical grounds for acceptance. 


Nature of Suggestion. Suggestion has 
been known and practiced ever since 
mankind settled in tribal communities. 
From comparative religion we know 
that suggestion effects and hypnotism 
have been utilized by the religious 
leaders of all the ages from the witch 
doctors of primitive races to the cultist 
priests of modern faith healing centers. 
Mesmer(16) was the first to attempt to 
deal with hypnotism by scientific meth- 
ods but his explanations in terms of 
“animal magnetism’’ have long since 
been discredited. Braid(5) refined the 
methods of inducing hypnotism and 
reached the conclusion that suggestion 
rather than magnetism was the real ex- 
planation. Liebeault and Bernheim(+) 
perfected modern techniques of hypno- 
tism and founded the Nancy school 
which developed systematic applications 
in psychotherpay. For the details of 
the latest development in technique, the 























































reader is referred to LeCron and Bor- 
deaux(13). 

McDougall(15) attempted to describe 
the dynamics of suggestion by postu- 
lating a distinct and specific instinct of 
submission whereby the submitting 
members of a herd or flock respond 
tamely and quietly to the self-assertion 
of dominant leaders. This theory has 
been subsequently discredited by failure 
to substantiate the existence of specific 
instincts in humans by experimental 
methods. 

Freud(10) defined suggestion and its 
therapeutic indication as “influence on 
a person through and by means of the 
transference-manifestations of which 
he is capable. The eventual independ- 
ence of the patient is our ultimate ob- 
ject when we use suggestion to bring 
him to carry out a mental operation 
that will necessarily result in a lasting 
improvement in his mental condition.” 
Freud(10) and Ferenczi(9) are in agree- 
ment that increased suggestibility is not 
instinctive but depends upon a distinct 
type of personality reaction of the child 
to authoritarianism in adults in which 
the child reacts to dominance by a gen- 
eral inhibition of thought and returns 
temporarily to a phase of infantile 
credulity, submission and_ self-surren- 
der. 

Lecky’s(12)_ self-consistency theory 
of personality may be developed to ex- 
plain further aspects of suggestibility 
in terms of the person’s conceptions of 
himself. Persons conceiving of them- 
selves as inferior in intelligence and 
other attributes frequently show sub- 
missive behavior because of their exag- 
gerated compensatory conceptions of 
the values of conformism, perfection- 
ism, the assets of other persons, and 
uncritical acceptance of domination 
irom others. Suggestibility is thus ex- 
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plained on the basis of childhood con- 
ditionings, conditioned dominance- 
submission ratios, attitudes toward one- 
self and toward others. 


Persuasion. Perhaps the oldest formal 
technique of psychotherapy is the 
method of common sense analysis dat- 
ing back to Socrates and Plato. Feible- 
man($) has compared the dialectic 
method of Socrates, Plato’s use of the 
clenchus, and Freudian psycho-analy- 
sis, reaching the conclusion that all 
three approaches have the common ob- 
jective of discovering and removing 
false propositions or conclusions which 
result in illogical beliefs. The elenchus 
is a question-and-answer method of 
cross-examination in which contradic- 
tions in a person’s beliefs are elicited 
for the purpose of revealing error, in- 
consistency and conflict. The objective 
of the method is to precipitate a recon- 
sideration of consciously and subcon- 
sciously held beliefs, thereby removing 
the false beliefs which are the basis of 
false action leading to maladjustment. 
According to Feibleman, common sense 
is the set of beliefs held by the mem- 
bers of a social group. These common 
sense beliefs are experienced originally 
during the learning process on con- 
scious levels, but are later assimilated 
and organized on subconscious levels. 
Possibilities for the advancement of a 
culture (and of an individual) are con- 
sidered to depend upon the extent to 
which existing beliefs may be constantly 
refined through learning and relearn- 
ing. Although many corrective influ- 


ences exist in every culture which tend 
to constantly refine and modify the 
views of both the group and the per- 
son, this process is very slow and un- 
certain, particularly in individual cases, 
and therefore cannot be depended upon 
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to produce individual adjustment. The 
method of the elenchus whereby truth 
is elicited by cross-examination may be 
contrasted with the eristic method in 
which the aim of exhibiting fallacies by 
eliciting contradictions becomes second- 
ary to the egoistic goal of winning 
arguments. In the eristic method, the 
participants are competitors who pre- 
tend superior knowledge and seek to 
defeat the opponent. 

Dubois(7) outlined in 1909 a system 
of psychotherapy intended to appeal 
primarily to the patient’s intellect by 
(a) clarifying the development of 
symptoms in relation to situational and 
personality difficulties, (b) emphasizing 
psychosomatic relationships between 
affective disorders and physical symp- 
toms, (c) explaining the effect of fear 
and anticipation in stimulating hypo- 
chondriacal reactions, and (d) reassur- 
ing the patient concerning minor func- 
tional disorders. These explanations 
are graded in complexity according to 
the client’s understanding, and have the 
objective of supplanting affective reac- 
tions with intellectual controls. The 
counselor is in effect an educator who 
is able to explain certain phenomena 
which were previously frightening and 
disturbing to the client. Alvarez(2) 
uses essentially the same method today 
in the treatment of psychosomatic con- 
ditions and reactions to constitutional 
inadequacy. 

In evaluating the therapeutic values 
of persuasion, Diethelm(®) concludes 
that the method is valuable in combina- 
tion with reeducation in the treatment 
of minor complaints and as an adjunct 
to major therapy. Persuasion may be 
used in treating the vicious circle of 
anticipation, fear and self-observation 
which tend to magnify minor symp- 
toms which in turn stimulate further 


uncertainty, fear and self-observation. 
The prestige of the counselor and the 
authoritarian form of the explanations 
tend to reassure the client by sugges- 
tion, and may prevent further deprecia- 
tion of morale. The basic reference by 
Dubois(7) still merits careful reading 
in spite of the fact that persuasion has 
been discredited as a major form of 
psychotherapy and is now limited to 
the handling of minor problems. 


Advice. The giving of one’s opinion, 
either solicited or unsolicited, concern- 
ing possibilities for altering the life- 
style of the maladjusted person is the 
basis of direct advice. This form of 
therapy is practiced almost universally 
by relatives and acquaintances, most 
commonly by untrained counselors, and 
with great caution by competent thera- 
pists. Its validity has been seriously 
questioned by the psychoanalytic dis- 
covery that intellectualized advice is not 
effective in dealing with affective fac- 
tors in maladjustment. It is recognized 
that advice operates on superficial 
levels and is rarely effective in dealing 
with deeper etiologic causes. 

Even though direct advice may be 
completely ineffective in dealing with 
the more severe disorders involving 
depth factors in personality, it may have 
specific therapeutic value in connection 
with situational maladjustments of nor- 
mal people. Clients with unimpaired 
personality resources are usually ca- 
pable of accepting advice for what it is 
worth, retaining the grain and rejecting 
the chaff. Recognizing that the value 
of direct advice will be correlated with 
the wisdom and comprehension of the 
counselor concerning the complexities 
of the immediate situation, the exigen- 
cies of therapy may permit the coun- 
selor to giving his opinion concerning 
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the most profitable course of action. 
Examples of such situations are when 
the client is to be seen only once, or 
where a decision must be made imme- 
diately, or where the counselor pos- 
sesses some bit of information which 
may be the key to the client’s problem, 
and is accepted as such. 


Present Status. The current popularity 
of passive methods of psychotherapy 
as represented by certain schools of 
psychoanalysis, nondirective therapy 
and the orthopsychiatric movement has 
been associated with the abandonment 
of older directive methods involving 
suggestion, persuasion and advice on 
the grounds that they involve an un- 
democratic coercion, violate the client- 
centered principle, and instill dependent 
attitudes in the client. It is contended 
by such authorities as Lowrey(14) or 
Rogers(18) that the well-trained thera- 
pist never uses such methods which are 
considered valueless and even detri- 
mental to therapeutic progress. It is 
stated that the client knows what is 
best for himself and will eventually ar- 
rive at a satisfactory solution of prob- 
lems by a growth process after his re- 
sources have been released by the re- 
moval of emotional blocks and con- 
flicts. 

In our opinion, there is a middle 
ground between the crude authoritarian 
methods of the past and the extreme 
passivism which has developed in reac- 
tion to them. Ferencezi(9) was correct 
in emphasizing the limitations of sug- 
gestion but erred in failing to recognize 
its positive values. Freud early aban- 
doned hypnosis as a primary method 
of psychoanalysis, but the recent ad- 
vances in hypnoanalysis open stimulat- 
ing avenues of approach to levels of 
personalities hitherto accessible only 


through sedation. A renewal of interest 
in determining through research their 
nature, indications and _ contraindica- 
tions offers great hope that we will soon 
be better oriented concerning the actual 
values of these ancient methods. 


TECHNIQUE 


General Considerations. Since the prin- 
cipal objective of persuasion, sugges- 
tion and advice is to facilitate learning 
of new and more adequate modes of 
behavior, it follows that the total situ- 
ation should be handled to provide op- 
timum conditions of learning. In the 
emotionally disordered person, this im- 
plies that conditions should be such as 
to minimize the chance of increasing 
the affective instability. Here is an op- 
portunity to apply all that has been 
learned about the psychology of influ- 
encing people through indirection. A 
number of general rules may be formu- 
lated to facilitate the conditions of in- 
fluencing the client when indicated in 
the plan of therapy. 


1. Attempts kept at a minimum. At- 
tempts to influence the client should 
be limited only to situations where 
a real indication exists. The effect 
is lost when personal influence is 
used indiscriminately. 
Not too early. Except in emergency 
situations, no attempt to influence 
the client should be made until after 
problems have been clarified. An 
accepting, permissive attitude early 
in therapy will do much to facilitate 
cooperation by the client at later 
stages. 

3. Not too often. Influence should be 
reserved only for points of critical 
importance. Its value is depreciated 
when used in connection with minor 


Iu 


~ 


matters. 
4+. In impersonal terms. Moralistic, 
censorious, judgmental, “‘holier- 
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than-thou” attitudes are strictly 
contraindicated. Matters must be 
dealt with on an impersonal level, 
keeping attention focussed on basic 
issues rather than interpersonal rela- 
tions. 

5. Client responsibility. The objective 
is to broaden the client’s perspective 
by presenting alternative solutions 
of which the client was formerly 
unaware. Ultimate responsibilty for 
deciding courses of action to be 
the client’s responsibility. 

6. Authoritarianism contraindicated. 
The use of firm positive suggestion 
does not necessarily involve the giv- 
ing of commands or orders. Per- 
emptory, dictatorial attitudes are 
contraindicated. The object is to 
lead by positive influence. 


Although objective research has not 
yet been performed concerning the op- 
timum phraseology of suggestion, per- 
suasion and advice, clinical experience 
indicates the superiority of a quiet, 
tactful, indirect approach which does 
not stimulate interpersonal tensions. A 
tentative comparison between acceptable 
and unacceptable approaches is offered 
in the following table : 


Acceptable 

“Another way of looking at it might be .. .” 

“What would you think of .. .” 

“For what it may be worth, here is how 
others have solved this problem.” 

“Let’s see if that is the only solution of the 
problem.” 

“You feel that is the only solution of the 
problem.” 

“Perhaps you would like to know the latest 
psychological (medical) theories on this point.” 

“What are the percentages of this being a 
success ?” 

“T wonder what the smartest way of doing 
might be.” 

“How would you like to...” 


Unacceptable 
“IT think that you should .. .” 
“The only thing for you to do is. . .’ 
“I’m going to tell you what to do.” 
“Tf I were you I would .. .” 


“There’s only one right way to do it.” 

“I want you to do this...” 

“There is a better way to do.” 

“You must try to do this.” 

“There is only one smart way to do this.” 

“If you don’t do this, you'll be sorry.” 

“Tf you don’t decide to do it yourself, you'll 
find you'll have to anyway.” 


As emphasized by Freud(10), definite 
rules for the conduct of therapy can 
only apply to its beginnings and end- 
ings; in the middle, the therapist must 
intuitively choose the response best 
suited to the individual situation. 


Principles of suggestion. Many failures 
of directive therapy which have dis- 
credited its past use may be explained 
as resulting from a lack of understand- 
ing of the principles of effective sug- 
gestion. Suggestion methods are not 
miraculous in their operation and can 
be expected to be effective only within 
the limits of what is scientifically pos- 
sible. The novice tends to issue direc- 
tives which are not only impossible of 
execution but actually harmful of rap- 
port since the client himself understands 
how illogical such demands are. In 
order to achieve a working outline of 
the principles of effective suggestion in 
clinical practice, a number of tentative 
laws have been deduced as follows: 


1. The Law of Professional Prestige. 


Anything which diminishes — the 
prestige of the counselor or thera- 
pist automatically destroys the 


therapeutic relationship. 

Corollary A. The appearance, be- 
havior and personal environment 
of the therapist should conform 
to the highest professional stand- 
ards of time and place. 

Corollary B. Case handling should 
be conducted at all times so that 
the therapist maintains overall 
control in a manner designed to 
install confidence in the client. 
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The Law of Logical Direction. Di- 
rectives which are not within the 
range of what the client considers 
logical, reasonable, and within the 
possibilities of accomplishment will 
be rejected. 

Corollary A. Suggestions should 
be specific and limited to soluble 
aspects of the problem. 

Corollary B. Positive suggestions, 
carefully worded, are most effec- 
tive in securing ready acceptance 
of an idea. 

The Law of Concentrated Atten- 
tion. After Baudoin(3) suggestion 
is most effective when nothing is 
allowed to distract the client from 
concentrated attention on an idea 
which then tends to realize itself. 

Corollary A. To minimize distract- 
ing affective reactions, directives 
should be given impersonally with 
an impartial, nonjudgmental atti- 
tude. 

Corollary B. Suggestions may be 
reinforced by association with 
appropriate intellectual or emo- 
tional attitudes. 

The Law of Reversed Effect. In 

the presence of preexisting attitudes 

to the contrary, positive suggestions 
are ineffectual. For example, the 
harder one tries to control natural 
functions, the less effective is the 
effort as in attempting to fall asleep. 

Corollary A. Clients should not be 
expected to exert will-power to 
control functions which are best 
influenced by removing aetiologic 
causes. 

Corollary B. The best results are 
frequently achieved when the 
client ceases active efforts and 
allows nature to take its course. 

The Law of Indirection. Sugges- 

tions are most effective when the 

client is not aware that they are 
being given and thinks they are his 
own idea. 

Corollary A. Overt direction, pres- 


sn 


sure or coercion are to be avoided 
because productive of interper- 
sonal tension and negativism. 
6. The Law of Dominant Affect. After 
Pierce(17), suggestions are most 
effective when associated with the 
dominant affect of the moment. 
Corollary A. Comprehension of the 
client’s dominant motivations are 
an important clue to the nature 
of suggestions which will be 
effective. 

Corollary B. Conversely, sugges- 
tions will be ineffective which op- 
pose dominant affective states. 


Diagnosis. The mature healthy per- 
sonality is able to accept direction for 
what it is worth, profiting by the opin- 
ions of other people. It is intelligent 
to discover the opinions of others, par- 
ticularly if they are older and of greater 
experience. The well adjusted per- 
sonality therefore seeks to sample the 
opinions of others, accepting what is 
valid and rejecting the rest. In con- 
trast, maladjusted persons reveal patho- 
logical trends in their reactions to 
authority, rejection of normal direc- 
tion, and general uncooperativeness. 
Accompanying these abnormal _ per- 
sonality reactions is a breakdown of 
interpersonal relations and communica- 
tion, resulting in a client who ts tmac- 
cessible and resistive. 

It is therefore valuable to sample the 
client’s reactions to reasonable sugges- 
tions. The occurrence of dispropor- 
tionate personality reactions in the 
client provides valuable clues to areas 
of maladaptation, and may be skill- 
fully utilized in diagnosis and _treat- 
ment. Some indication of the frequency 
of negativistic personality reactions oc- 
curring at the beginning of treatment 
in mild psychoneurotic and situation- 
ally-maladjusted normal persons may 
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be obtained from the results of a pre- 
liminary analysis to be reported here. 
An unselected sample of 112 consecu- 
tive cases referred for private consulta- 
tions during a two year period was 
rated according to the attitude of the 
client on first contacts. The ratings 
were made on the basis of a five point 
scale given in table 1. 

It is apparent from the above data 
that great differences exist in the per- 
sonality reactions with which _ the 
therapist is faced. In contrast with 
psychoanalysis and nondirective therapy 
in which the therapist attempts to deal 
only with those who will at least co- 
operate sufficiently for the basic method 
of therapy to operate, the therapist who 
accepts all types of cases will be con- 


fronted with many clients who are 
brought for treatment against their 


will by relatives or civil officials who 
have determined that the client will sub- 
mit to treatment whether he wishes to 
or not. 

The method of choice will depend 
upon the attitude of the client at the 
heginning of treatment. With clients 
showing a positive wholly cooperative 


attitude, many more therapeutic possi- 
bilities are available than with the 
client showing negativistic attitudes 
which must first be dealt with before 
deeper problems can be approached. 
The decision to utilize directive meth- 
ods will depend upon the diagnosis as 
to whether the client is able to profit 
from an active approach. If the coun- 
selor moves slowly, feeling the client 
out gradually without stimulating ex- 
cessive negative reactions, no very 
great damage will be done if attempts 
at direction are rejected. Good rapport 
will permit the therapeutic relationship 
to survive many events potentially un- 
pleasant or threatening to the client. 


INDICATIONS 


Limited objectives of therapy. It is not 
proposed that suggestion, persuasion 
and advice constitute a major method 
of therapy capable of effecting a 
complete personality reorganization. 
Rather, these methods are most suitable 
for accomplishing limited objectives 
determined by the needs of the indivi- 
dual situation. The variety of such 
situations is so infinite that no attempt 


TABLE 1. Classification of personality reactions shown by 112 private patients during 
initial interviews 








Personality Reactions 


Cases Per cent 





1. Very cooperative. Sought treatment on own initiative. Reaction 


genuinely positive. 
2. Cooperative with reservations. 
get it here. 


SPR ia 6s th ore 5 aa Sale is ee ee 
Neutral and somewhat indifferent. 
vinced therapist can help .............. 
Did not want to come for consulta- 
Openly suspicious of ther- 
‘ apist ; however will talk. Reactions predominantly negative. .... 33 


3. Polite on surface. 


4. Poorly concealed negativity. 
tion; resents having been brought. 


Openly negativistic and resistive. 


ur 


Tentatively accepts therapist. 
i oe Se RGIS We GEE OArioR 29 26.0 


Able to accent critically: io... cael con eeu: 9 8.0 
Wants help but not certain can 


Affective reaction 


Not con- 
28 25.0 


if at all. Disparages therapist and treatment. Rejects efforts to 


entsiaes THOPONE |. es 5 es cae es ete 





29.4 
Answers only with compulsion 
Ry es Sen per eet 13 11.6 
fie cede kkk van th 112 100.0% 
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can be made to list them here. In gen- 
eral, suggestion is indicated in (a) an- 
tagonizing the effects of negative sug- 
gestions, (b) stimulating positive atti- 
tudes, (c) catalysing desirable actions 
on the part of the client, and (d) 
carrying the client over minor diff- 
culties while major problems are being 
solved. Persuasion may be effective in 
explaining and clarifying problem situ- 
ations which the client’s inexperience 
prevents him from solving alone. Ad- 
vice is reserved for limited situations 
for which a clear cut solution exists 
which the client seems capable of ac- 
cepting and acting upon intelligently. 


Children and immature personalities. 
Where the client does not possess suf- 
ficient personality resources to achieve 
a solution unaided, suggestion and per- 
suasion are usually very effective in in- 
fluencing the client to do those things 
which are necessary if he is to maintain 
his normal pattern of living. The 
efficacy of such influence will depend 
upon emotional stability, hence emo- 
tional disorders may have to be dealt 
with first before results can be expected. 


Mental defectives. Persons with im- 
paired personality resources respond 
well to suggestion, advice and persua- 
sion from one who is trusted. During 
the 8 years when the author worked in 
an institution for mental defectives of 
all ages, and was daily required to deal 
with patients who became violently dis- 
turbed, these methods were effective 
about 90 per cent of the time in secur- 
ing conformance to what was desired. 
Although being required to step in and 
terminate many fights and emotional 
outbursts, never once did a_ patient 
threaten the author or attack him per- 
sonally. 


Behavior problems. Many of the be- 
havior problems of childhood are re- 
lated to the fact that the child has not 
learned how to solve specific problem 
situations. Where the maladjustment 
is situational and does not involve 
deeper pathological mechanisms, rela- 
tively superficial methods of treatment 
are effective. The intelligent child will 
sit down and talk things over in 
straightforward manner, during which 
discussion it is relatively easy to direct 
attitudes in constructive paths. Situ- 
ational difficulties of adults are also 
susceptible to superficial therapy. 


Psychosomatic disorders. As indicated 
above, persuasion and logical explana- 
tion are particularly effective in deal- 
ing with visceral neuroses associated 
with hypochondriacal trends. Once the 
client appreciates that his symptoms 
are annoying but not dangerous, he is 
able to make compensatory adjustments 
which enable him to get along without 
intolerable anxiety. 


Psychoneuroses. Suggestive techniques 
have long been known to be effective in 
Conversion Hysteria, although perhaps 
only on symptomatic levels. In gen- 
eral, symptoms induced by suggestion 
may also be removed by suggestion. 
Suggestion and persuasion are also in- 
dicated in Anxiety Hysteria to secure 
limited objectives. 


Psychoses. Suggestion may be very 
effective in influencing belligerent psy- 
chotics who would resist direct orders 
or commands. 


(CONTRAINDICATIONS 


Attempts to Shift Responsibility. 


Clients frequently request advice in 
support of actions with ulterior motiva- 
tions which they wish to rationalize or 
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shift responsibility for. Examples of 


such situations include : 

The man who wants to be advised to 
get a divorce so he can marry his 
mistress. 

The man whose affairs are in such 
hopeless condition that he wishes to 
leave town to escape from it all. 

The young person who desires a good 
rationalization for leaving school. 

The person who wishes to break a mar- 
riage engagement for insufficient 
reason. 


In our opinion, it is rarely desirable 
to give advice in such situations which 
are better handled nondirectively so as 
to bring to the surface all the motives 
determining the situation. 


Negativistic personalities. With clients 
whose problems lie in the area of diffi- 
cult interpersonal relations and _reac- 
tions against authority, it may be pre- 
dicted that suggestion and persuasion 
will fail because of affective factors 
which preclude their being reacted to 
intelligently. Occasionally such _ per- 
sonalities may be influenced by sug- 
gesting the opposite of what is in- 
tended, but the results are in general 
poor. 


Major decisions. Clinical experience 
has indicated that it is unwise to at- 
tempt to influence the client with major 
decisions or in recommending courses 
of action potentially associated with 
dangerous results. Although pertinent 
evidence may occasionally be presented 
to advantage, major decision must be 
left for the client to decide by himself. 
Particularly contraindicated is advice 
to the effect that the client should ex- 
periment with extramarital relations, 
alcohol, changing jobs, moving away, 
getting a divorce, selling his house, 
entering into financial transactions, ete. 


The client may be influenced against 
unhealthy or criminalistic reactions, but 
such should never be suggested. 


ILLUSTRATIVE CASE MATERIAL 


Illustrative of the therapeutic use of 
suggestion is our practice of dealing 
with symptoms in which suggestibility 
plays a prominent etiologic role by 
utilizing powerful counter-suggestion. 
This may be done verbally, or using 
some placebo which impresses the client. 
In Case 1, the development of an hys- 
terical anesthesia was promptly coun- 
teracted by using a painful electrical 
stimulation over the areas reported by 
the client to be numb. 


Case 1. T. K., male, age 26, veteran. 
Referred for consultation because of 
neurasthenic condition. Unable to work 
because of extreme fatigue. Complained 
of a variety of peculiar sensations over 
the body in bizarre distributions. On 
awaking every morning would go over 
body to see if anything new had de- 
veloped. Any new or strange feeling 
would send him almost into a panic. 
Would begin to feel dizzy and giddy, 
burst out in perspiration, feel faint, and 
actually passed out on a few occasions. 

This man was constitutionally inade- 
quate and never had a good work ad- 
justment. Before the war was on the 
WPA. Married without source of sup- 
port. His disability allowance was only 
source of income. Was very resistant 
to psychotherapy. 

At the fourth month of treatment, 
he came to office one day complaining 
of numbness and anesthesia in both 
legs, worse on right. This anesthesia 
did not conform to nerve distribution. 
Since an electroshock apparatus was 
handy, the electrodes were attached 
over the calf muscles and he was given 
several shocks of 60 volt intensity last- 
ing % second. Sensation returned im- 
mediately. Pt. was evidently disturbed 
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at the pain of the shocks, and appre- 
hensive that the treatment might be re- 
peated. He was told that since the 
treatments were so effective, they 
would be used over other locations 
whenever he reported bizarre sensa- 
tions. Following this treatment, pa- 
tient had no more complaints about pe- 
culiar sensations. 

Comment: This veteran presented a 
constitutionally inadequate personality 
and had developed a compensation neu- 
rosis since his disability allowance was 
only source of income. Was very sug- 
gestible and developed a variety of 
hysterical symptoms. Powerful sug- 
gestion in the form of painful electrical 
stimulation was effective in removing 
hysterical anesthesia and other bizarre 
sensations. This was only symptomatic 
treatment with limited objectives but 
at least it removed part of the disability. 


The use of persuasion is illustrated 

in Case 2 in which a veteran with a 
severe psychoneurosis of three years 
duration which had not responded well 
to treatment in army psychiatric in- 
stallations was markedly improved 
after two months treatment. 
Case 2. Y.C., male, age 23, veteran. 
Considered to be a normal healthy per- 
sonality until exposed to severe hard- 
ship and strain in South Pacific. Was 
on torpedoed troop ship and _ later 
bombed for 3 months on Guadalcanal. 
Suddenly developed combat fatigue. 
Became very tense and anxious; unable 
to sleep for more than two hours; had 
repeated attacks of unconsciousness re- 
sembling syncope more than convulsive 
disorder. Was treated for 18 months in 
various army hospitals and psychiatric 
wards. No marked improvement; 
finally discharged at own request be- 
cause felt better home than ‘n camp. 

Now working only 44 to ™% time. 
Feels good on arising but a wave of 
fatigue comes over him after working 
a couple of hours. Slight noises make 


him go to pieces. Has passed out on 
several occasions without warning. 
Unable to watch movies or ball game 
because of tension feelings which be- 
come intolerable. Unable to sleep at 
night. 

The key to patient’s neurosis was a 
dream recurring nightly in which he 
would hear voices calling for help but 
he seemed powerless to help them. 
Would wake up in a nightmare scream- 
ing; felt panicky and as if he was 
going to die at these times. 

Since it appeared that this dream was 
a projection of his own anxiety and 
need for help, he was encouraged to 
tell in the minutest detail about his own 
illness and everything that had hap- 
pened to him in army hospitals. He 
said: ‘Nobody ever told me anything. 
I was always on the N-P ward. I saw 
other guys going nuts and said what 
am I doing here? They kept me under 
amytal for months at a time because I 
couldn't sleep without it. . At the 
VA hospital | went in and saw the psy- 
chiatrist and he said: “Name 5 impor- 
tant cities.”’ I gave him the names of 5 


places in Vermont. Then he said: 
“Name 5 important rivers.” I gave 
them. Then he said: “That's all.” 


When I got home I found my pension 
was cut. How do you like that? The 
next time I went down there, I saw the 
same doc. He asked me the same ques- 
tions, and then he said: “You are a 
lot better now.” I said: “Pardon me 
sir, but you don’t know how I feel.” 
He said: ““What are you trying to do, 
cause trouble around here?” I said: 
“No. Just drop it.” The client then 
went on to relate many other events 
which had stuck in his mind. . 

The treatment consisted in working 
through his experiences and feelings, 
explaining psychosomatic symptoms in 
simple terms, suggesting always that 
his troubles were all functional, reassur- 
ing him that they were annoying rather 
than dangerous, and outlining many 
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possible ways of handling his problems. 
Once that he understood that he was 
not losing his mind or developing some 
dread nervous disease, steady improve- 
ment occurred each week. 

Comment: This case illustrates a 
general principle that hypochondriacal 
complaints and anxiety hysteria tend to 
become worse if the patient’s unbridled 
imagination is allowed to run away 
with him. Nondirective handling and 
failure to interpret and give reassur- 
ance may result in an exacerbation of 
symptoms as the client imagines that 
the worst is being hidden from him. 
Straightforward explanations are often 
effective in allaying anxiety symptoms. 


Direct advice may be utilized to ac- 
complish limited objectives in therapy 
where it is desirable for the client to 
take definite action. In this role, the 
therapist may be considered comparable 
to the movie production director whose 
function it is to secure optimum per- 
formances from the actors. With the 
insights related to his superior train- 
ing and experience. the therapist is fre- 
quently able to prescribe plans for ac- 
tion which have specific value in solv- 
ing partial aspects of the problem. We 
do not hesitate to suggest such advice 
when convinced that it may work. 


Case 3. Mr. and Mrs. A came for 
consultation at the suggestion of rela- 
tives concerning a difficult marriage 
problem. It appeared that their mar- 
riage was about to break up. Both 
parties had a long history of neurotic 
behavior; their marriage partially rep- 
resented an unsuccessful attempt to 
solve problems dating back many years. 
Now both parties are in a state of con- 
tinuous emotional instability, sleeping 
poorly, quarreling constantly, and gen- 
erally failing to adjust well in any area 
of life. Mr. A is unable to do his work 
properly and is in danger of losing his 
job and all means of support. He is de- 


pressed and shows much anxiety. He 
gives the impression of being on the 
verge of emotional demoralization lead- 
ing to a complete breakdown. Mrs. A 
teels very insecure as she feels every- 
thing slipping out from under her. Mr. 
and Mrs. A are very aggressive toward 
each other, bickering all the time, blam- 
ing each other, and making frequent 
humiliating remarks. Both had reached 
the decision that divorce was the only 
solution. 

A brief evaluation of the total situ- 
ation indicated that something must be 
done fo stabilize things immediately 
and to offset a total breakdown if pos- 
sible. It quickly became apparent that 
irreparable damage was being done at 
home by the unending and completely 
unsatisfactory discussion of their prob- 
lems. A directive was therefore issued 
that both parties must cease discussing 
personality problems at home; that if 
one started, the other must remain pas- 
sive; and that there must be an end to 
the vicious circle of aggression and re- 
taliation. Mr. A accepted this directive 
and made a fairly successful effort to 
avoid the bitter unkind remarks which 
he had been making. Mrs. A at first 
said that she was incapable of con- 
trolling herself. She said that she 
simply had to give expression to her 
feelings and could not restrain herself. 
The therapist presented the problem as 
an exercise in learning emotional con- 
trol. It was firmly insisted that she 
must stop verbalizing all her negative 
feelings. After about a month, Mrs. A 
suddenly began doing much better. In- 
terpersonal relations became sufficiently 
improved so that they could at least 
live together even though basic prob- 
lems were still unsolved. Therapy con- 
tinued on deeper levels directed toward 
basic problems. 

Comment: This case illustrates how 
direct advice is utilized to accomplish 
limited objectives in therapy. Here 
something had to be done to break up 
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the vicious circle of aggression and re- 
taliatory behavior which had been es- 
tablished between husband and wife. 
Unless this was accomplished, the mar- 
riage could not continue and much 
ground would have been lost in attack- 
ing the deeper problems. 

In this case, nondirective handling 
was insufficient to break up the pattern 
of interpersonal relations. Both parties 
expressed and clarified their feelings 
completely but this did not change the 
basic home situation. 


DIscUSSION 


When used with reasonable skill and 
clinical judgment, the methods dis- 
cussed in this paper are potentially very 
valuable and at the same time relatively 
safe. Assuming that suggestion, per- 
suasion and advice are reasonable, the 
worst that can happen is that they will 
be rejected. We are not in agreement 
that they inevitably violate the client- 
centered principle and stimulate unde- 
sirable personality reactions such as un- 
healthy dependence. On the contrary, 
it is desirable for every person to learn 
to react critically to attempts to influ- 
ence him by other persons. Much is 
gained if the person learns to accept 
constructive influence for what it is 
worth, while rejecting illogical or un- 
appropriate suggestions. 

We are not impressed with the con- 
tention that only the client can work 
out his own solutions to problems. 
After all, every person is daily sub- 
jected to gratuitous advice and sugges- 
tions from the multitude of people in 
his environment. The psychological 
scientist is the person who possesses 
the most valid source of knowledge 
concerning mental hygiene problems. 
Admitting that this source of informa- 
tion may be fallible and incomplete, it 
is still the best available at the time and 


place. Instead of being bound down by 
theoretical considerations of what will 
and what will not work, the eclectic 
attitude is to try everything possible in 
the hope that somewhere a solution will 
be found. 

SUMMARY 


The classic psychotherapeutic meth- 
ods of suggestion, persuasion and ad- 
vice are reevaluated in terms of modern 
conceptions of their role in the thera- 
peutic armamentarium. When compe- 
tently used it is concluded that they are 
valuable in accomplishing limited ob- 
jectives in therapy. The nature of sug- 
gestion is discussed in relation to its 
clinical applications and a number of 
principles for its optimum use are pre- 
sented. Indications and contraindica- 
tions of the methods are presented, to- 
gether with illustrative case materials. 
In our opinion, the use of these methods 
does not violate the client-centered prin- 
ciple ; on the contrary, they may operate 
in specific manner to facilitate the de- 
velopment of insight. 
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THE WONDERLIC PERSONNEL TEST AS A PREDICTOR 
OF SCORES ON THE AMERICAN COUNCIL ON 
EDUCATION EXAMINATION 


DAVID J. 


Personnel Research Institute, 


INTRODUCTION 


The Wonderlic Personnel Test(5) 
has been recently advocated by Lind- 
zey(1) as a valuable “‘pre-test’ psy- 
chometric technique in the counseling 
situation. The Wonderlic test was 
recommended because of the short time 
(12 minutes) required to administer it 
and because of its usefulness in deter- 
mining the “‘battery of tests to be ad- 
ministered.”” In particular, it was 
recommended as a tool for deciding 


CHESLER 


Western Reserve University 


The cases of 100 male veterans who 
had been given both tests were selected 
at random from the files of the Per- 
sonnel! Research Institute of Western 
Reserve University, and the test scores 
were subjected to statistical analysis. 


RESULTS 


Correlations between the Wonderlic 
and each of the scores on the American 
Council test and the standard errors of 
estimate were as follows: 








Total A.C.E. 


A.C.E. Q-Score A.C.E, L-Score 





W onderlic 


69 + .05 67 + 06 





whether a college aptitude test or an 
intelligence test on a lower level should 
be included in the final test battery. It 
was the purpose of the present study 
to check these recommendations quanti- 
tatively by determining the relation- 
ships between the Wonderlic test and 
the American Council on Education 
Psychological Examination for College 
Freshmen, 1944 Edition(2), and the 
value of the former in predicting scores 
on the latter. 


These correlations are not as high as 
one ordinarily expects between tests of 
intelligence or learning ability. 

Means, standard deviations, and 
standard errors of the means are pre- 
sented in Table 1. The entries in the 
bottom row are percentile rankings 
corresponding to the mean score en- 
For the Ameri- 
can Council test the percentile rankings 
are derived from the norms issued with 


tries mm the first row. 








WONDERLIC PERSONNEL TEST 83 














TABLE 1, 
W onderlic Total A.C.E. Q-Score L-Score 
OP niteiVinvenecseedccesa: ae 113.07 43.71 69.32 
* ES ar hry eg ppetare a ee 6.09 24.53 10.88 16.67 
IE Se 0.61 2.45 1.09 1.67 
NE Risa iced xacn eke kes 61.60 52.69 47.48 56.90 
the test for males at 281 colleges." For American Council tests give an inter- 


the Wonderlic test the percentile entry 
in Table 1 is based upon Wonderlic’s 
norms for males between the ages of 

18 and 30 who have had 3 to 4 years 
of schooling(4). Such a group is com- 
parable to the subjects in the present 
study. 

The mean percentile ranking on the 
\Wonderlic is higher than any of the 
three American Council scores. This, 
of course, was expected from the na- 
ture of the groups upon which the 
different norms are based. The dif- 
ferences are, however, comparatively 
small when interpreted in terms of 
standard deviation units. Between mean 
Wonderlic performance and mean Total 
A.C.E. performance the difference is 
0.228 standard deviation units. Be- 
tween mean Wonderlic performance 
and mean Q-score performance the dif- 
ference is 0.351 standard deviation 
units. And in the case of the L-score, 
the difference is 0.122 
viation units. 

Most vocational counselors, and 
many psychologists, prefer to interpret 
test performance in percentile terms, 
although the advantages of a standard 
score system aregtoo well known to be 
discussed here,# Since the manuals 
issued with the Wonderlic and the 


' These norms are Tables 2, 5, and 6 of the 
manual, Psychological Examination for College 
Freshmen, 1944 Norms (3), in which per- 
centiles are computed to the midpoints of class 
intervals. In the present study the exact percen- 
tiles of all American Council test scores men- 
tioned were computed. 


standard de- 





_ predicted score minus one 


pretation of scores in percentile terms, 
a study was made of the percentile 
rankings that could be expected on the 
American Council test from percentile 
rankings on the Wonderlic test. The 
regression equations in raw score form 
of Total A.C.E., Q-score, and L-score 
on the Wonderlic (\W), and the stand- 
ard errors of estimate are as follows: 
Total A.C.E. = (3.07W + 30.26) + 15.86 


= 
Q-Score = (1.23W + 10.50) + 7.89 
L-Score = (1.83W + 19.83) + 9.16 


These regression equations were used 
to determine the data for Table 2, 
which shows the predicted American 
Council scores for selected Wonderlic 
scores and the corresponding percentile 
ratings. The entries in columns 3, 7, 
and 11 are predicted American Council 
raw scores. The upper entry in each 
cell in columns 4, 8, and 12 is the pre- 
dicted score plus one standard error of 
estimate, and the lower entry is the 
standard 
error of estimate. The entries in 
columns 5, 6, 9, 10, 13, and 14 are 
corresponding percentile rankings for 
the raw score entries. 

In all but a few of the percentile cells 
of Table 2 the range of percentile 
rankings is quite large. These percen- 
tile ranges are small only at the upper 
extreme, although even at percentile 90 
on the Wonderlic, ranges covering 37, 
48, and 31 percentile units may be ex- 
pected on American Council total score, 
Q-score, and L-score respectively. At 
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percentile 10 on the Wonderlic, ranges 
covering 21, 23, and 24 percentile 
units may be expected, and in the 
middle of the distribution the percen- 
tile ranges are larger. In the 30 cells 
which show percentile rankings for pre- 
dicted scores, the range of percentile 
units is less than 20 in 3 cells, between 
21 and 30 in 6 cells, between 31 and 
40 in 8 cells, between 41 and 50 in 10 
cells, and 51 or more in 3 cells. This 
indicates the caution that must be ob- 
served when a short “pre-test” is used 
to determine the lengthier tests that 
will be used in a final battery. The 
data in Table 2 also constitute a warn- 
ing not to estimate too readily scores 
on one test from scores on another. It 
is believed that the value of Table 2 
in the counseling situation lies in the 
fact that it presents the range of scores 
that may be expected on a compara- 
tively lengthy and well known college 
aptitude examination from scores ob- 
tained on a short pre-test type of exam- 
ination. 
SUMMARY 


This study presents data showing the 
relationships between scores on the 
Wonderlic Personnel Test and the 
American Council on Education Psy- 
chological Examination, and the use- 
fulness of the former in predicting 
scores on the latter. Correlations be- 
tween the Wonderlic test and each of 


the scores on the American Council 
test range from .67 to .76. 

Since in the counseling and clinical 
situation, test performance is usually 
interpreted on the basis of percentile 
norms issued with the test, an analysis 
is presented of the percentile rankings 
that may be expected on the American 
Council test from percentile rankings 
on the Wonderlic test. The results show 
wide ranges of expected percentile 
rankings on the American Council test. 
The expected percentile ranges are 
relatively small only at the upper ex- 
treme. It is felt that under such condi- 
tions caution must be observed when a 
short “pre-test,” like the Wonderlic, is 
used to determine what lengthier tests 
will be included in the final battery, or 
to estimate probable performance on 
the lengthier test. 
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THE MINNESOTA MULTIPHASIC PERSONALITY INVENTORY : 
AN. EXTENSION OF THE DAVIS SCORING METHOD 


FRANCES A. 


Psychologist, Bureau of Child Study, Chicago Board of Education 


INTRODUCTION 


In a recent paper, Davis(!) has pre- 
sented a method of scoring and analyz- 
ing the MMPI which he states will 
reduce the time required for the clerical 
work by one-half. His method, how- 
ever, does not allow for the use of the 
“K” scale published in 1946. Since the 
correction obtained by the “K’”’ scale 
has been found to be of value in sharp- 
ening the discriminatory power of five 
of the nine clinical variables yielded by 
the MMPI(3), it seemed desirable to 
expand Davis’s method to take into ac- 
count the K values of each test item. 


DIRECTIONS 


Mark each card on the back with the 
numbers given by Davis(1), with the 
exception of the corrections given be- 
low. Use red ink for the italicized num- 
bers in Davis’s list and for those 
marked ‘‘red’”’ below; use black for all 
others. Where several numbers are to 
be written on one card, write them one 
under the other in numerical order. 


CORRECTIONS AND ADDITIONAL 
CARD MARKINGS 


A-3 red 3 5 C-18 red » ee 
red 4 red 6 4 
red 5 red 9 
red 6 4 red 10 2.0 
red 9 red 11 2 
red 10 C-27 red Se 
red 11 2 red GR 
B-ll black 5 pee 
red 10 
black 9 red 11 12 
B-55 red ae C-28 black 3 5 
black 6 6 black 6 .4 
red 9 black 9 
red 10 black 10 
red 2 eee. bleak: - 21. 2 
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C-33 


D-48 


D-51 


D-53 


D-54 


E-43 


red 
red 
red 
red 
red 
red 
red 
red 
black 
black 
black 
black 
black 
black 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 


red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 
red 


red 
red 
red 
red 
red 


black 
black 
black 


10 


10 


10 
11 


3 
6 
9 
10 
11 


3 
5 
6 


uw bh 


+ 


se 
-wm bo 


> in to 


wm to 


1.4 


> in bo 


io 


1.4 


F-8 


F-20 


F-33 


F-46 


G-18 


G-23 


black 
black 
black 
red 
red 
red 
red 
red 
black 
black 
black 
black 
black 
red 
red 
red 
red 
red 
red 


red 
black 
red 
red 
red 
red 
red 
red 
red 
red 
red 


red 
red 
black 
red 


red 


black 
black 
black 
black 
black 
black 


black 
black 
black 
black 
black 
black 
black 


red 
red 
red 
red 


10 
11 


6 


10 


10 


min bo 


mb 


min to 


Sin bo 





L 


wm to 


ts bs 


tim bo 


bo 


cn 


uw to 
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red 10 red 9 
red | meee red 10 

G-30 black 3 55 red ol 2 
black 6 14 I-37 red Se 
red 7 black 4 
black 9 red 4 
black 10 red 10 
red H 6-2 red Sai. 

G-31_ red a 2 1-38 red gee 
red 4 red ree 
red 6 A red 9 
red 9 red 10 
red 10 red i: ae 
red i 

iin sg oe ee 
black 6 4 black 4 
black 9 black 5 
black 10 blak 6 4 
black 1 1 Pe black 9 

I-31 red Sg black 10 
red ee black 11 2 


ScorInGc METHOD 


The scoring proceeds as outlined by 
Davis(1), but his scoring formulae for 
the five variables affected by the “K”’ 
correction must be changed as_ indi- 
cated in the following list. A number 
not followed by a decimal value is 
given the value 1.0. 


Hs: Sum of values of cards marked (3) in black 
plus (10.5 minus sum of values of cards 
marked (3) in red) 

Pd: Sum of values of cards marked (6) in 
black plus (16.4 minus sum of values of cards 
marked (6) in red) 

Pt: Sum of values of cards marked (9) in 
black plus (23 minus sum oi values of cards 
marked (9) in red) 

Sc: Sum of values of cards marked (10) in 
black plus (23 minus sum of values of cards 
marked (10) in red) 

Ma: Sum of values of cards marked (11) in 
black plus (12.2 minus sum of values of cards 
marked (11) in red). 


After the raw scores have been ob- 
tained by these formulae and by the 
formulae given by Davis for the other 
variables, they may be entered directly 
in the tables given in the Supplemen- 
tary Manual (3) to derive the corrected 
T scores. 


The advantage of the present method 
over the use of the score sheet and 
stencils provided by the authors of the 
test is in the efficiency of checking the 
accuracy of the scoring. Because of the 
introduction of decimals and the in- 
creased number of times some of the 
cards must be handled in the scoring 
process, the time saving in a first scor- 
ing produced by the original Davis 
method does not continue when the K 
corrections are added. However, there 
is a very grave possibility of clerical 
error in both the score-sheet and the 
card-sorting methods of scoring and 
neither should ever be accepted without 
a complete check. When the score sheet 
is used, a very large potential source of 
error is in incorrect placing of the cross 
on the score sheet to correspond to a 
given infrequent answer. It is there- 
fore necessary to perform this opera- 
tion twice and compare the two score 
sheets, as well as to count with each 
stencil twice. When there is disagree- 
ment between the two prepared score 
sheets, the process of verifying the 
correctness of one or the other is very 
time-consuming. 

With the card-sorting method, after 
the raw scores of each scale from 1 to 
11 have been obtained as described by 
Davis, if the sorting has been neatly 
and efficiently done, the process can be 
readily reversed, beginning with scale 
11 (Ma) and working back to scale 1 
(L.) in much less time than it took to 
sort and distribute the cards on the 
first scoring. Further, when disagree- 
ments are found, an immediate check 
can be made. In practice the total time 
saved in arriving at completely checked 
scores has been found to vary greatly 
with the accuracy of the original scor- 
ing. With three different scorers. time 
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savings ranging from 5 to 30 minutes 
per record have been found. 


SUMMARY 


The Davis method of scoring the 
MMPI has been extended to include the 
K scale corrections on five of the vari- 
ables. The decimal values thus intro- 
duce slow the process of original scor- 
ing to a point where it possesses no time 
superiority over the score-sheet and 
stencil method on the first score, but 


great efficiency in the checking of the 
scoring has been achieved. 
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A NOTE ON THE USE OF THE BELLEVUE-WECHSLER SCALE 
MENTAL DETERIORATION INDEX WITH BRAIN 
INJURED PATIENTS 


ROBERT M. 


ALLEN 


The University of Miami 


A recent article(2) suggests a quick 
method of evaluating intellectual de- 
terioration and utilizing the resulting 
Mental Deterioration Index (M. D. I.) 
for differential diagnosis. The M. D. I. 
technique is fully described by Wechsler 
(3, pp. 54-69) and is based on statistical 
computations involving two groups of 
subtests of the Bellevue Intelligence 
Scale: those that “hold up” relatively 
well with age: Vocabulary or Compre- 

* Published with permission of the Chief Medi- 
cal Director, Department of Medicine and 
Surgery, Veterans Administration, who assumes 


no responsibility for the opinions expressed or 
conclusions drawn by the author. 


hension, Picture Completion, Object 
Assembly and Information; and those 
that “do not hold up”: Arithmetic, 
Digit Span, Digit Symbol and Block 
Design. In this report the authors have 
widened the application of the age 
M. D. I. to its use as “a specific factor 
in leading to an accepted differential 
diagnosis’’(2, p. 405). Their 15 cases 
fell into four categories, three of which 
referred to distinguishing between or- 
ganic involvement and/or a disturbed 
personality state. 

During the course of a preliminary 
survey of test findings with brain in- 











TABLE 1. /J/ntellectual deterioration distribution for 50 brain injured patients with 
Wechsler M. D. 1. 
No Less Than 10-20% More Than 
Loss 10% Loss Loss 20% Loss Total 
NN ak eas 8 6 9 27 50 
PONOUE 65.65 bebe 16 12 18 54 100 
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TABLE 2. Summary of mean subtest weghted scores of 50 brain injured on Bellevue 
intelligence scale 








tug I Cc A D Sp 


So wa ORE Oa OD RSs 





10.2 11.14 10.26 8.66 6.68 


9.24 8.64 9.36 7.6 7.9 6.86 





* These letters are the first letters of the subtests. 


jured patients} the present author(1) 
evaluated the vulnerability of the Belle- 
vue Intelligence Scale subtests to trau- 
matic encephalopathy. Application of 
the Wechsler M. D. I. formula resulted 
in the distribution of intellectual losses 
as seen in Table 1. This formula defi- 
nitely screened out only 54 per cent of 
the total study group of 50 patients. It 
did not disclose any appreciable loss in 
28 per cent of the cases while it pointed 
up a loss-trend in the remaining 18 
per cent. 

Our findings(!) suggest that the inclu- 
sion of the Object Assembly subtest 
weighted score in the Hold group is 
not justified when applying the M. D. I. 
formula to brain injured cases. This 
subtest is the third most seriously im- 
paired being outranked only by Digit 
Span and Digit Symbol as least re- 
sistant to the encephalopathic process. 
Table 2 depicts the distribution of 
subtest weighted scores obtained in 
our study. Further analysis of the 


+ Brain injured, as differentiated from brain 
diseased, are those patients who suffered an 
actual penetration of a bullet or piece of shrapnel 
into the encephalon. 


scores indicates the possible use of the 
following formula as differentiating 
between the normal and the brain in- 
jured: Information plus Comprehen- 
sion weighted scores greater than Digit 
Span plus Digit Symbol weighted 
scores by approximately five points or 
more. This statistical combination of 
subtest weighted scores needs valida- 
tion with other types of patients and 
the author offers it only as a lead to 
further investigation. 

In summary, it is felt that the use of 
the Object Assembly subtest weighted 
score in Wechsler’s Hold group needs 
reexamination when the formula is ap- 
plied to encephalopathic patients. It 
has proven to be especially vulnerable 
in post-traumatic organicity. 
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THE FRAME OF REFERENCE OF THE THEMATIC 
APPERCEPTION TEST 


HARRISON G. GOUGH 


University of Minnesota 


INTRODUCTION 


Recent advances in psychology have 
again emphasized the importance of the 
integrational, purposive, and evaluative 
aspects of personality. Allport(2) has 
shown that these factors were recog- 
nized by early psychologists such as 
James, Royce, and Dewey; positivistic 
opposition to their dianoetic treatment 
of the concepts led to a rejection of the 
problems they dealt with, as well as 
their explanations. The result of this 
rejection was the relative neglect of 
such factors as the consistency and 
unity of mental life, values, ideals, self- 
conceptions, ambition, and status, and 
the assumption of leadership in dynamic 
and clinical psychology by psycho- 
analysis. The rapidly increasing inter- 
est in the clinical field within psychol- 
ogy proper has given new impetus to 
holistic thinking, and a large body of 
research is growing up around such 
concepts as level of aspiration, ego- 
involvement versus task-involvement, 
and frames of reference. Enigmatical 
issues such as the generality or specific- 
ity of personality traits(2), the organiz- 
ing factors in perception($), and varia- 
tions in retention and learning(1), have 
been greatly clarified by these concepts. 

Clinical psychology in particular is 
closely related to these developments, 
with its attention to the structuring of 
personality, the organization of experi- 
ence, and the various clues and diag- 
nostic signs which enable the observer 
to infer the nature of these processes. 
It is, in fact, the theory of projective 
tests that a person’s interpretation of an 
ambiguous stimulus is as indicative of 
his own characteristic modes of reac- 


tion as it is of the inherent qualities of 
the stimulus. The relationship between 
clinical tests and these theoretical con- 
cepts must be carefully explored. Much 
has already been done along this line 
(see, for example, 11), but as far as 
the writer knows the importance of the 
frame of reference on the Thematic 
Apperception Test has not received spe- 
cific notice. The present paper will at- 
tempt a brief discussion of this relation- 
ship. 


THe FRAME OF REFERENCE 


A frame of reference may be defined 
as a set of facts or accepted principles 
in reference to which a person thinks, 
defines situations, forms judgments, 
habits, and attitudes. It is a sort of 


general orientation, a focus around 
which experience is organized. New 


situations are structured in accordance 
with a frame of reference; when the 
new situation is so ambiguous that the 
frame of reference is not meaningfully 
applicable, an imposed definition may be 
accepted. However, this external defi- 
nition will be accepted only if it does 
not violate some basic tenet of the ob- 
server's referential scheme. 

In the Thematic Apperception Test 
the directions attempt to define the situ- 
ation as one involving a test of the 
imagination; the intended purpose is 
masked or obscured by Murray’s in- 
structions : 


This is a test of imagination, one form of 
intelligence. I am going to show you some 


pictures, one at a time; and your task will be 
to make up as dramatic a story as you can 
for each. Tell what has led up to the event 
shown in the picture, describe what is hap- 
pening at the moment, what the characters 
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are feeling and thinking; and then give the 
outcome. Speak your thoughts as they come 
to your mind... .(7, p. 3). 


Wells and Ruesch(15, p. 187) sug- 
gest that projective pictures be pre- 
sented as “imagination tests.’ Rapa- 
port and Schafer(8, p. 77) do not men- 
tion “imagination” in their instructions 
to the subject, merely asking him to 
make up a story about the picture; they 
do speak, nevertheless, of the danger 
of his becoming “‘alert’” to what the 
examiner is driving at (p. 80). Shaf- 
fer(12) recommends introducing the 
test as one of imagination, as does Rot- 
ter(10), 

Most of the literature on the test in- 
dicates that it is accepted as a test of 
imagination by the majority of the sub- 
jects. Rosenzweig and Isham(9, p. 
129) state that the subject is ‘unaware 
of the purpose of the instrument.’ Sy- 
monds(13, p. 516) mentions that the pur- 
pose of the test is hidden from the sub- 
ject. Combs(4+) makes the following 
Statement : 


Since the significance of the materials re- 
vealed is necessarily unknown to the subject 
and since he is purposely misled as to the 
reasons for administration of the device, he is 
stripped of his protective armor and is at the 
mercy of whatever individual or agency 
interprets these results (p. 74). 


There is little reason to doubt that 
ordinarily the test is presented and ac- 
cepted as a test of imagination, and that 
the subject is not explicitly aware of the 
interpretive implications of his produc- 
tions. At the same time, there is no 
reason for assuming the invariancy of 
this situation. Rather, the clinician 
should be prepared for subjects who do 
not adopt this frame of reference, and 
should have an idea of what the test can 
do when this occurs. It is the conten- 
tion of this paper that such deviations 


do occur, that the imposed frame of ref- 
erence is not always accepted. 

Whenever the purpose of the test is 
known, or recognized, the frame of 
reference as a test of imagination is ob- 
viously dispelled; also, when a subject 
deliberately utilizes the pictures as a 
point of departure for describing his 
difficulties, the test of imagination 
orientation is inapplicable. When either 
of these two situations obtains, and 
cooperation is sustained, the result 
seems to be a series of allegorical stories 
whose import is as obvious to the sub- 
ject as to the examiner. It must be 
admitted, of course, that even frankly 
self-revelatory remarks can be inter- 
preted on other levels, or.may betray 
other than the intended meaning. 

The TAT has a therapeutic as well 
as a diagnostic usefulness ; Woolley(17) 
claims that the former is its more im- 
portant function. Jacques(5) has dis- 
cussed the time-saving in treatment 
afforded by the TAT. In any thera- 
peutical relationship some proportion of 
time at the beginning is spent in estab- 
lishing rapport, confidence, a feeling cf 
ease and acceptance. There is, appar- 
ently, some sort of ego-defensiveness, 
some factor of pride or cautiousness, 
which prevents the subject from giving 
a complete formulation of his problem 
at the start; there must be a short pe- 
riod of graceful retreat and face-sav- 
ing before intimate attitudes, hopes, 
etc., are revealed. 

Procedures such as the TAT are able 
to shorten the time spent on these pre- 
liminaries.! The subject, when aware 
of the functions of the test, or when 


1. One of the advantages of semantics as a 
therapeutical tool is that corrections can be 
couched in its psychologically neutral terms, 
which, if stated in usual language, would pro- 
voke antagonism and resentment. One can ad- 


mit the faulty use of multi-ordinal terms with- 
out threatening the ego, whereas the admission 
of irrational attitudes could not be tolerated. 
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utilizing it as described above, is able 
to tell about his own ideas, wishes, guilt 
feelings, and fears in a much more inti- 
mate fashion than he could if “really” 
talking about himself. Therapist and 
subject play a game, as it were, in which 
the stories are allegories whose impli- 
cations are not elucidated. The subject 
finds it easier to express his deeper feel- 
ings in this permissive, “‘as if’’(6, p. 60) 
situation, with its convenient possibili- 
ties of denial and repudiation. The re- 
sistance and reluctance of the subject to 
tell about himself are thus indulged and 
the benefits of catharsis and ventilation 
are realized. The stories also encour- 
age an objective, analytical attitude to- 
wards the problem.? 


SUMMARY 


The opinion appears justified that 
the frame of reference defined by the 
test instructions is not always the one 
adopted by the subject. When a dif- 
ferent frame of reference is utilized the 
form of response to the pictures may be 
altered. In the therapeutic situation, 
the subject aware of the purpose of the 
test may organize his remarks about the 
picture, but deliberately incorporate 
feelings and ideas which he might feel 
inhibited in expressing directly to the 
examiner. When this occurs, the time 
usually spent in testing the relationship 
and establishing confidence is short- 
ened, and some of the benefits of ven- 
tilation accrue as well. The subject 
unaware of the function of the TAT, 
but with an urgent desire to express his 
problems, may do the same thing. 


2. Thorne(14) points out that the case history 
in and of itself may be a therapeutic device. 
The systematic consideration fostered by the 
clinical setting influences the subject to regard 
more aspects than he had before, and to seek 
new relationships and meanings. This is in ad- 


dition to the desensitization following ventila- 
tion, and the increased security engendered by 
the therapist’s permissiveness and interest, 
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A CASE OF EXTREME LANGUAGE DISABILITY CONCEALED 
BY STUTTERING* 


MILTON B. 


JENSEN 


Louisville, Kentucky 


INTRODUCTION 


The purpose of this paper is to re- 
port an unusual case of extreme lan- 
guage disability concealed by stutter- 
ing. 

In thirteen years experience with 
stutterers we have not previously dealt 
with one who (a) had so marked a 
language disability, (b) reported the 
onset of the speech difficulty so clearly 
and fully, (c) gave such evidence of 
purposive speech disorder, and (d) re- 
sponded so satisfactorily to increased 
knowledge of the mechanics of speech 
and reading. 

This stutterer has reinforced our be- 
lief that different factors operate to 
produce speech disorders in different 
individuals. As we review our ex- 
perience it seems that each stutterer 
had different reasons for stuttering but 
that each had a reason. Therefore, mass 
attack on the genesis of stuttering is 
unlikely to yield much of value to the 
individual stutterer. We feel that the 
percentage of stutterers who begin stut- 
tering volitionally to attain some end 
is larger than generally supposed. We 
have worked with several cases recently 
in which the evidence for such a con- 
clusion was considerable: One stut- 
tered in imitation of an admired play- 
mate. One stuttered to avoid account- 
ing for misbehavior and_ succeeded. 
Another stuttered as a part of a simu- 
lated “nervousness” to escape school 
and work. A fourth stuttered to secure 
attention and sympathy. Therapy was 


* Paper read before the Mid-Western Psy- 
chological Association, Chicago, May, 1947. 


facilitated by acceptance of these mo- 
tives as working hypotheses. The clini- 
cian dealing with disorders of speech 
should devote considerable time to in- 
vestigation of motive before proceeding 
with therapy, since therapy is unlikely 
to be permanently effective unless the 
desire of the stutterer for normal 
speech becomes greater than his wish 
for the end sought through stuttering. 


Case REPORT 


Past history. The patient, an unmarried 
woman of 21 years was referred to us 
early in November 1946 by a neuro- 
surgeon who found “no organic base” 
for her speech difficulties. She stut- 
tered badly on her first visit to the 
clinic and said that she always had 
trouble with speech. Her lips trembled 
and there were severe spasms in the 
muscles of the face and neck during 
“blocking.” Her mother reported that 
she had been stuttering for about ten 
years and that it was worst during 
menstrual periods. 

Birth was normal, according to the 
mother, and there were no neurological 
nor behavioral evidences of cerebral 
damage. She had the usual childhood 
diseases and possibly a mild case of 
poliomyelitis at age three from which 
she still “drags one foot a little.’ She 
was well nourished. Her appearance 
was not typical of the “nervous” or 
“neurotic” individual, nor did she have 
symptoms of marked autonomic in- 
volvement : Extremities were warm and 
dry. No indigestion. A little consti- 
pation. Neither leucorrhea nor dys- 
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menorrhea. No palpitations. No evi- 
dence of extreme tensions except when 
speaking or about to speak. Sleep was 
reported as undisturbed and restful. 
Patient is one of two children 
(brother 18 months younger than she) 
in a family of slightly better than aver- 
age economic status. Her parents are 
relatively unschooled—-about — eighth 
grade—but are aggressive and manage 
their affairs well. There is no evidence 
of serious personality disorder in the 
family background. The father and 
both children are gainfully employed 


at better than average wages. Family 
relationships are good though the 


mother is more than normally domi- 
nant, particularly with the patient. 
School history is reported as normal 
until age ten or eleven when stuttering 
was first noticed. At that time school 
grades in subjects involving reading 
began to fall off. She failed English 
and Science in the ninth grade, Eng- 
lish, Science and American History in 
the tenth grade and English in the 
eleventh grade. She graduated from 
high school at age eighteen after what 
is described as a “great struggle.” 
Patient gets along fairly well at her 
place of employment but is inclined to 
be short tempered and discourteous at 
times, She says she is timid and fear- 
ful with her superiors but has made 
better adjustments since her speech has 
improved. She is surprised at how 
much better people like her when she 
is pleasant with them. Her social life 
is abnormally restricted. At first she 
said she didn’t like boys. Later she 
admitted that it was from fear that 
they would hear her stutter or discover 
how little she knew about words that 
she avoided them. She has developed a 
fanciful attachment to a young man 
whom she saw only once and whom she 
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has never met. She says that she would 
like to get acquainted with him but has 
made no move in this direction in sev- 
eral months though she knows his 
mother fairly well. Our interpretation 
is that she is using the romantic idea 
of him as a safeguard against beconiirg 
involved emotionally with men who 
are more available. When charged with 
this she admitted that it might be true. 
She says she has normal sex urges and 
a desire for a home and family but 
that sex does not bother her much as 
long as she is busy. She has a few close 
girl friends whom she sees infrequently 
since most of them are married or have 
moved away. 


Test results. Mental efficiency was 
somewhat impaired, apparently from 
emotionality. On the Wechsler-Belle- 
vue she scored low on digits (—), 
arithmetic (——-—), and picture ar- 
rangement (—), but high on digit sym- 
bols (+). Subtest scores were: 10, 10, 
7, 4, 8, (8), 8, 13, 14, 15, 13 (1Qs 90, 
117, 103). On the Shipley-Hartford 
Retreat Scale she scored nearly aver- 
age in terms of mental efficiency: CQ, 
96 (vocabulary, 21; abstractions, 20). 
In the test situation it appeared that the 
extreme lowness of some of her scores 
resulted from fear of detection of her 
deficiencies though there was no ques- 
tion regarding her weakness in dealing 
with language concepts. 

Reading was pathetically poor. On 
Gray's Oral Reading Paragraphs she 
made a raw score of 16—about third- 
grade level. In paragraph 3 pray was 
read as ‘“‘pardon.”’ In paragraph 4 were 


was read as “had.” But and then were 
omitted and “the” was inserted before 
queen in the next to the last line of 
paragraph 4. There were seven errors 
in paragraph 5 involving the following 
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words: ever, bird-room, had, reared. 
On Gates Reading Survey for Grades 
3 to 10, Form I, she scored: vocabu- 
lary, 60 (age 14-0, grade 8.3); com- 
prehension, 51 (age 14-4, grade 8.6). 
She missed such words as commence 
(defined “country’”). bewail (defined 
find’), enrage (defined “‘start”’), triv- 
ial (defined “friendly”), ecstasy (de- 
fined “jewel”), and molest (defined 
“abolish” ). The letters b, d, p, and gq 
were read almost interchangeably. 

Most of her preferences are right. 
There is some ambivalence in writing, 
kicking and folding of hands and arms. 
ye movements were particularly poor 
with a great deal of jerking and back- 
tracking. Acuity, convergence and ac- 
commodation were normal or better. 

Score. on the Mooseheart Phonetic 
Discrimination Test was 94 as against 
an average of 95. On the Seashore 
Measures of Musical Talent she scored 
very low in all but Time: Pitch, Rank 
10 (score 22); Loudness, Rank 9 
(score 36); Rhythm, Rank 10 (score 
22); Time, Rank 6 (score 39); 
Timbre, Rank 10 (score 30); 
Tonal Memory, Rank 10 (score 16). 
Our observations are in harmony 
with these test scores: She could dis- 
criminate between but had only a brief 
memory for short sounds and virtually 
no memory for combinations of 
sounds. We consider this disability her 
major handicap in reading. 

Patient had very few complaints of 
either ideational or physiological na- 
ture, certainly not a typical neurotic. 
On the Rohde-Hildreth Incomplete 
Sentences she projected feelings of 
inadequacy, envy, self-consciousness, 
fear of boys and sex. and little-girl 
fantasies relative to being a queen. On 
the Rorschach, using Montalto’s 
scheme she scored about as follows: 


AGE 





DISABILITY 95 


Fair intellectual maturity. Poor crea- 
tive intellectual capacity and poor use 
of that present. Poor rational but rigid 
intellectual control of emotions. Saw 
relationships poorly. Poor introspec- 
tion and tact. Not anxious or compul- 


sive. Fearful of the external. Good 
social adjustments. Not impulsive. 


Stereotyped in thinking. Not a popular 
thinker. Normally responsive to exter- 
nal stimulation. In terms of our ex- 
perience with the Rorschach she was 
not hypochondrical, not sexually dis- 
turbed, and no pathology was present. 
Subsequent experience with the patient 
verified most of these findings. Her 
behavior might be described as mildly 
schizoid. On Rotter’s Level of Aspira- 
tion Test she scored as rigid with a 
low degree of self-confidence. In the 
clinical situation we found her to be 
very rigid relative to changing opin- 
ions though serious and industrious in 
improving her mastery of language. 

On Kuder’s Activities Interest Scale 
she scored “Indifferent” or “Dislike” 
in all fields. Percentile scores were: 
Mechanical, 5; Computational, 71; 
Scientific, 55; Persuasive, 50; Artistic, 
79; Literary, 63; Musical, 81; Social 
Service, 19; Clerical, 35. Actually 
there is very little in which she is vitally 
interested. She works diligently at her 
place of employment from a sense of 
duty rather than from interest or en- 
thusiasm. 


interpretation. We interpret the stut- 
tering of this woman as a conscious, 
volitional attempt to avoid detection 
of extreme difficulty with language. 
Our reasons are as follows: 


1. The patient remembers the onset of 
stuttering. She says it started more 
or less accidentally one day when 

On that 


she had to read in class. 
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occasion she was excused because 
of her stuttering. She discovered 
that whenever she stuttered she 
avoided the task that would have 
exposed her lack of knowledge and 
inability to pronounce words. 

2. She stuttered only on words she 
did not know, usually on words she 
could not spell and could not define. 

3. She has ceased to stutter on words 
she has learned to recognize by 
sight and sound. We have taught 
her phonics and she does not stut- 
ter on the words that she can re- 
member nor on longer words if she 
can break them down into small 
words and remember the sounds and 
their sequence. Once she learns the 
movements involved in sounding a 
word she no longer stutters on that 
word when using it in conversation. 
When reading she must recognize 
the word visually as well as remem- 
ber the movements involved in 
sounding it. If these processes are 
thoroughly learned she does not 
stutter. We have taught her through 
kinesthesis and visual cues, much as 
one proceeds with those born deaf. 

4. If the materials she is to read are 
carefully censored so that there are 
no words with which she is un- 
familiar she does not stutter. 


Prognosis in this case, so far as 
speech is concerned, is excellent. She 
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has made about five grades progress 
in oral reading in nine months. For 
the first month or so we saw her two 
one-hour periods per week; then one 
hour per week and later once a month. 
During the first few weeks a girl friend 
helped her with reading for from forty 
to sixty minutes per day. Since then 
she has had no help other than that 
received in the clinic. She says that 
she never stutters if she avoids words 
she does not know. She reads aloud 
at home, using a mirror and following 
recordings made in the clinic. These 
records have been made with pauses so 
that she can pronounce either before 
or after the recording. This has been 
particularly helpful in word building. 
The rigidity of her personality per- 
sists and impedes social adjustments. 
We consider her improvement in speech 
due mainly to two factors: (1) In- 
creased knowledge and mastery of the 
mechanics of speech and (2) Decrease 
in effort to avoid detection. She has 
not entirely overcome her distrust of 
people. Under sodium pentothal she re- 
sisted attempts to get her to discuss 
her personality problems. She started 
the first interview by informing us that 
she would tell us only what she wanted 
us to know. She closed it by asking if 
we found out what we wanted to know. 














DETECTION OF CIRCUMVENTION IN THE MINNESOTA 
MULTIPHASIC PERSONALITY INVENTORY* 


H. BIRNET HOVEY 
Veterans Administration Hospital, Salt Lake City 


The author has noted that an occa- 
sional S will try to outwit in a special 
way, the card set of the Minnesota 
Multiphasic Personality Inventory()). 
In two cases, the Ss were hysteroid in- 
dividuals with character anomalies who 
were believed to be falsifying physical 
symptoms for compensation and other 
purposes. One desired to give the im- 
pression of being in excellent emotional 
condition, the other wanting it believed 
that he had a “normal personality” 
structure. They discovered the signifi- 
cance of the cards’ truncated corners, 
placed all the cards with the lower, left- 
hand cut corners in the “true” category, 
and in the “false” category those cards 
Then 
they selected between twenty and thirty 
of the more innocuous items and trans- 
ferred them to the opposite categories, 
presumably to conceal artificial re- 
sponses in the set as a whole. A third 
S with similar interest neglected this 
last step. 

* Published with permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who assumes 


no responsibility for the opinions expressed or 
conclusions drawn by the author. 


with the opposite corners cut. 


Detection by the examiner of this 
procedure is fairly simple and is re- 
flected primarily in the K and L scales. 
The raw K score is likely to be 21 or 
near that, and determined by the “O” 
items on the K scoring stencil. Few 
or no “X” items on the same stencil are 
likely to be picked up for the raw K 
score. The raw L score is likely to be 
zero or nearly so. If every card in the 
set is placed according to the cut corner 
as described in the previous paragraph, 
the raw K score will be 21 with all the 
“O” items counted with the stencil and 
none of the “X” items counted; and 
the L score will be zero. The two Ss 
mentioned both produced raw K’s of 21 
based entirely on “O” responses, one 
had a raw L score of zero and the other 
a score of one. 

Additional indications of artificial re- 
sponses are low uncorrected raw scores 
on all three of the Hs, Pt and Sc scales. 
Neither S produced more than a raw 
score of two on any of these scales. 


REFERENCE 
1. Meent, P. E. and HatHaway, S. R. The 
K factor as a suppressor of variance in the 
Minnesota Multiphasic Personality Inven- 
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Increasingly difficult problems con- 
front us in our attempt to expand the 
services of this Journal in the face of 
an inflationary spiral in printing costs 
which have more than doubled since the 
lifting of OPA restrictions. Publica- 
tion of scientific specialty journals un- 
der private auspices has always been 
considered to be risky business since 
few such projects have ever been self- 
supporting. Unlike official publications 
which are usually subsidized either 
openly or indirectly, the privately spon- 
sored journal must either pay its own 
way or slowly wither from lack of sup- 
port. Only a limited number of solu- 
tions potentially exist to these difficult 
financial problems. Ideally, the best so- 
lution would be to sell a large enough 
volume of subscriptions to offset rising 
costs. Unfortunately, however, the po- 
tential market is limited by the number 
of clinical psychologists and also by the 
fact that many psychologists have not 
developed the habit of systematically 
subscribing to professional journals in 
order to acquire a private library. It 
is to be hoped that more psychologists 
will see the value of acquiring complete 
collections of reference journals. As 
announced in the October issue, special 
rates have been extended to students 
who wish to begin to build their own 
libraries. 

Beginning with this issue, this Jour- 
nal is adopting the policy of accepting 
suitable papers for prior publication at 
author’s expense. Printing costs will be 
charged to authors under this arrange- 
ment, while this Journal will assume its 
share of operating costs. Under this 
plan, longer papers will be accepted and 
published as Clinical Psychology Mono- 
graphs, the first of which appears in 
this issue. Monographs will first be 
published in regular issues of the 
Journal and also in single copies which 


may be purchased separately. A variety 
of arrangements may be made whereby 
the author may recover all or part of 
costs of publication through royalties 
on sales. It is expected that these ar- 
rangements will facilitate publishing 
arrangements for authors, while pro- 
viding a more valuable journal for 
readers. 

Two other alternatives exist which 
will be utilized only in the event that 
inflationary trends result in a complete 
breakdown of ordinary financial ar- 
rangements. Some publications have 
retrenched financially by reducing their 
size and content. This solution does 
not appear desirable in clinical psy- 
chology where demand for publishing 
space is rapidly increasing. The other 
sclution is to increase costs of indi- 
vidual subscriptions which we have 
pledged ourselves not todo. » «© + 
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During early stages in the evolution 
of all the clinical professions, there have 
heen periods before the development of 
objective methods for evaluating data 
in whici. new therapeutic discoveries 
have been made popular through the 
use of anecdotal testimonials gathered 
and disseminated by the proprietors of 
the new methods. The advocates of the 
new remedy are usually enthusiastic 
and sincere persons who have uncriti- 
cally accepted the persuasive salesman- 
ship of its originators who are not 
backward in its exploitation. Testi- 
monials of the patent medicine type 
have certain characteristics by which 
they may be instantly recognized. First, 
there are usually broad and largely un- 
substantiated claims that here is truly 
a miracle medicine capable of curing a 
wide range of ailments (sometimes en- 
tirely unrelated). Second, it is sug- 
gested that traditional methods of 
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diagnosis and treatment may be dis- 
carded since the new remedies make it 
possible for the proprietors or the per- 
son himself to conduct treatment satis- 
factorily without recourse to standard 
methods. Third, the new panacea is 
usually promoted as the exclusive and 
sensational discovery which is going to 
replace older methods because of its 
revolutionary nature; rarely is credit 
or reference made to antecedent or re- 
lated methods of other investigators. 
Fourth, these claims are usually ad- 
vanced by persuasive advertising and 
promotion. Fifth, some credence is 
given by unsolicited testimonials from 
persons who claim to have obtained 
startling results from the new remedy 
which beats everything they ever tried 
before. Finally, the proprietors of the 
new methods usually develop compli- 
cated rationalizations. in explanation of 
why the remedy is often ineffective in 
the hands of others. These explanations 
usually depend on claims that the out- 
siders do not truly understand the new 
method or how to apply it. F.C.T. 
5 A 


We have long regarded with resent- 
ment the system which exploits scien- 
tific workers by appealing to their high 
ideals in persuading them to work for 
material recompense far below wage 
levels commanded by even unskilled la- 
bor. There may have been some justi- 
fication for low salaries in the early 
days when the significance of scientific 
work had not yet been recognized and 
budgetary appropriations were insuf- 
ficient to provide recompense commen- 
surate to the value of the work done. 
Now that science has come into its own 
and won universal recognition, it will 
he desirable for scientists to be given 
earning power commensurate with 
their value to civilization. The situation 
is particularly serious in connection with 
the subsistence of graduate students. 
At a time when they are biologically 
most active and capable of enjoving 
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life, students are expected to live as 
ascetic celibates on the pittances which 
are doled out in the form of scholar- 
ships or teaching assistantships. While 
the bricklayer’s apprentice may earn a 
living wage, the scientific apprentice is 
expected to live on high ideals. Such 
an existence may temper the soul but 
it does not make for well-rounded per- 
sonality development. 

Perhaps a more difficult problem 
exists in relation to the matter of ac- 
cepting fees for conducting scientific 
work with commercial applications. 
Scientists find themselves in the posi- 
tion of working for glory while others 
exploit their work with great financial 
gain. A scientific caste system has de- 
veloped in which “pure” (usually aca- 
demic) scientists look down on “ap- 
plied” scientists who actually earn their 
living in the work-a-day world. For 
decades, academic positions have been 
considered as the peak of scientific re- 
spectability and one has almost lost 
caste if one, is forced to accept a com- 
mercial position. The few psycholo- 
vists who have achieved marked success 
in popularizing psychology in writings 
for the layman have been looked down 
upon almost as though they had prosti- 
tuted themselves. This situation exists 
in contrast to the medical profession 
where to be a highly successful practi- 
tioner is often the highest status. 

The practical nature of these prob- 
lems is emphasized by the fact that 
there exist some very real needs for 
the commercial applications of psy- 
chology, which needs will be met by 
charlatans unless professional psychol- 
ogy organizes itself to fulfill them. ior 
example, public demand for popular 
articles on psychology is so great that 
lay writers have no difficulty in selling 
pieces which contain more fiction than 
fact. There is also great need for con- 
sulting facilities where the average man 
could take his problems and have them 
dealt with in a sensible manner. At 
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present, the psychologist who attempts 
to supply these needs as well as earning 
a living for himself finds his motives 
questioned and his professional reputa- 
tion lowered. The professional societies 
need to face these problems realisti- 
cally, facing rather than sidestepping 
issues which will require imaginative 
solutions. A lesson might be learned 
from the present somewhat difficult po- 
sition of the American Medical Asso- 
ciation which ignored problems relating 
to group practice and socialized medi- 
cine for years only to find its prestige 
threatened as other public agencies 
faced the situation and outlined their 
own plans which the 4.1/4 has now 
found it difficult to accept. = ¢ 7. 
ry 


In our opinion, it is not desirable in 
the field of clinical psychology to con- 
tinue the currently popular practice of 
omitting academic titles and degrees 
when referring to a person with recog- 
nized doctoral training and professional 
certification. In academic circles, feel- 
ings of democratic equality or false 
modesty have led to the omission of 
the designations of “professor” or 
“doctor” as it has become customary 
to list staff members as “Mr.” Some 
institutions have gone still further and 
omitted indications of seniority by list- 
ing alphabetically, and even by holding 
popular elections to determine who will 
be chairman or head of the depart- 
ment. While the political desire to 
minimize class distinctions and egocen- 
trism is very laudable, this trend fails 
to do justice to other values which may 
be just as important. It is a common- 
place observation that the world rarely 
rates a man higher than he rates him- 
self. If professional training and com- 
petence in clinical psychology are worth 
anything, then they deserve to be dis- 
tinguished by some mark of respect 
such as the designation of medical 
physicians and dentists as “Dr.” The 
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psychologist with doctoral training has 
just as much right to courtesy titles as 
do other professional people, and _ it 
seems desirable to assert this right with 
honest self-confidence since by training 
and competence the psychologist de- 
serves equal status with other profes- 
sions. Some psychologists have been 
disinclined to be referred to as “Dr.” 
because they have mentally accepted 
their status as being lower than medi- 
cal men and are sensitive about doing 
anything which might cause them to be 
confused with medical physicians. In 
view of modern high standards of 
training in professional psychology, we 
do not feel that psychologists are en- 
titled to develop feelings of inferiority 
in relation to the medical profession. 
Certainly, if psychologists plan to work 
with people they will need all the 
prestige they can gather, and they 
should learn from student days (as do 
medical students) to accept the desig- 
nation of “Dr.” with proper modesty 
as their natural right. FCT. 
vy 


One of the most delicate points of 
possible contention between psychia- 
trists and psychologists is concerned 
with the question of whether psycholo- 
gists have a right to conduct “therapy” 


without medica] supervision. At one 
extreme stands a group who would 


deny the right to treat cases except 
under medical supervision. It is con- 
tended that only a licensed physician 
has legal or moral right to. assume re- 
sponsibility for the physical or mental 
health of the population. Also, that 
psychologists lack the training and ex- 
perience to judge whether any particu- 
lar case does not have disease processes 
which can only be dealt with medically. 
At the other extreme, stands a limited 
number of psychologists who claim 
after Freud that medical training is 
unnecessary and may even be unde- 
sirable for those engaged in psycho- 
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therapy. Quite naturally, the medical 


profession is loath to delegate any of 
the legal responsibility which is now 
vested in the medically trained physi- 
cian, while psychologists are desirous 
of expanding the borders of their field 
as widely as possible. The situation is 
further complicated by secondary fac- 
tors involving matters of power, group 
prestige, financial recompense,  etc., 
which tend to make each group suspi- 
cious of any attempt to curtail its ac- 
tivities. 

Ultimately, the question must be de- 
cided on the basis of who is best quali- 
fied to perform different services for the 
patient. Therapy is an omnibus term 
referring to a wide range of activities 
from remedial reading to narcosynthe- 
Medical physicians are undeniably 
better trained for certain types of 
therapy, while the modern curriculum 
developed particularly in the last five 
years provides clinical psychologists 
with superior training in other tech- 
niques. Speaking as one who has ex- 
perienced both medical and psychologi- 
cal training, we are inclined to value 
psychological training higher than do 
some medically trained persons. For 
example, better training in counseling 
methods is now available to psycholo- 
gists at recognized training centers, 
than is known to us in psychiatric cen- 
ters. Although horrible examples are 
currently quoted concerning what is 
being done both in psychiatry and 
clinical psychology, the best work in 
both fields adheres to comparably high 
standards. The most important con- 
sideration. is that each clinician shall 
limit himself to those areas in which he 
is competent by training and experience. 

¥. ¢. %. 
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If at times, the opinions expressed in 
these columns have seemed to be hyper- 
critical of official actions and _ policies 
in clinical psychology, this does not 
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mean that there is nothing which is 
good and healthy in our lusty infant. 
On the contrary, we are very much 
satisfied with the rapid evolution of the 
field within the last five years. To be 
singled out for particular commenda- 
tion are the reports of the d?A Com- 
mittee on Graduate and Professional 
Training, the rapid establishment of 
high calibre training facilities in many 
universities, the accomplishment of pro- 
fessional certification, the achievement 
of friendly relations with the Ameri- 
can Psychiatric Association, and the 
development of high calibre programs 
in the Federal agencies and particularly 
the Veterans Administration. Clinical 
psychology is maturing with an evolu- 
tionary spurt which is one of the few 
good results of World War II. To an 
unexpected degree, everyone seems in- 
clined to keep feet on the ground and 
head sizes within normal limits. Sin- 
cere in the opinion that clinical psy- 
chology can contribute something which 
the world greatly needs, we feel that 
our future is one of genuine scientific 
accomplishment which will permanently 
insure Our position. rice 
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A matter of the utmost importance 
in determining interprofessional rela- 
tionships between psychologists and 
psychiatrists concerns the problem of 
case referral. In the past, few psy- 
chologists have been able to build up 
congenial working relationships with 
their psychiatric colleagues, many of 
whom have taken the attitude that ulti- 
mate responsibility for case handling 
can reside only with medically trained 
personnel. A frequent complaint of 


psychologists has been that to refer a 
case was to lose a patient. Many psy- 
chologists have had the experience of 
having a psychiatric consultant refer 
disparagingly to the work of the psy- 
chologist, or to psychology in general. 
Rarely does the psychiatrist refer back 
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the patient to the psychologist, or even 
send a report concerning the consulta- 
tion. Psychologists have frequently 
been made to feel as though they were 
irresponsible quacks whose work was 
of little value. Doubtless there has been 
much which is questionable in the con- 
duct of both psychologists and_ psy- 
chiatrists, but sensational accounts of 
what has happened in single cases must 
not be allowed to becloud the total pic- 
ture. 

A simple solution to the matter of 
case referrals would be to apply the 
same rules of professional conduct to 
psychologist-psychiatrists relationships 
as are standard practice in medicine. 
The duties of physicians in consulta- 
tions are stated very clearly in the Prin- 
ciples of Medical Ethics of the Ameri- 
can Medical Association and seem ap- 
plicable with little change to interpro- 
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fessional relationships. It should be 
the obligation of the clinical psycholo- 
gist to ask for medical consultation in 
all situations where indicated, and to 
relinquish the patient for such medical 
or psychiatric treatment as may be 
necessary in the opinion of the physi- 
cian. It should be the obligation of the 
physician to deal with the psychologist 
as he would any other professional 
man, recognizing the rights and duties 
of each profession, and refraining from 
any action which would depreciate the 
value of psychological services. The 
attainment of cordial relations cannot 
he expected immediately, but must oc- 
cur as an evolutionary process as in- 
dividual psychologists and psychiatrists 
learn to work and get along together. 
Examples of what can be accomplished 
are numerous in the military services 


and also in private practice. » ¢ 7 
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A LETTER TO NON-PH.D. 


Somewhere along the line, it seems, 
the “rulers” of the 4PA have forgot- 
ten that they have dues-paying, non- 
Ph.D. associates who are competent, 
hard workers. Many of us who do not 
have the Ph.D. are frightened at the 
very sight of The American Psycholo- 
gist, so strong is its clamor for Ph.D. 
domination. I am not going to use 
much space telling you why I think this 
policy of treating the non-Ph.D. mem- 
bers so lightly is a poor one. Suffice to 
say that some of the most original work 
in the field of research in clinical psy- 
chology in recent years has come from 
individuals who do not have a doctor- 
ate. Rather than debating an issue I 
would rather spend the rest of this let- 
ter indicating what the non-Ph.D. 
‘might do to protect himself. 


MEMBERS OF THE APA 


It seems that we are destined to be- 
come assistants to some more impor- 
tant group of individuals. The ABE: PP 
will only certify individuals who have 
the Ph.D. degree. In addition, the 4 PA 
will seek to have states pass certification 
laws similar to that of their own. If 
this continues we will not be permitted 
to call ourselves psychologists. Ac- 
cording to Dr. Dael Wolfe, the APA 
has still to decide “upon appropriate 
occupational classifications, titles and 
relations with the APA of persons who 
do not hold the doctor’s degree but who 
are trained to do various types of psy- 
chological work.”” (See recent issue of 
The American Psychologist.) 1 would 
suggest that we decide this ourselves 
rather than to let it slip into the hands 
of a Ph.D. dominated APA. 
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Since our status must be that of an 
inferior to a more important group I 
would suggest that we ally ourselves to 
the American Medical Association, and 
enjoy a relationship with this group 
similar to that of social workers and 
chiropodists. Thus, in the state of Ohio 
the medical board issues certificates to 
chiropodists. As a result these indi- 
viduals are permitted to establish their 
own offices and enjoy a practice having 
to do with a limited phase of medical 
work. They enjoy, of course, all of the 
advantages resulting from being affili- 
ated with a medical group. 

By organizing ourselves and elect- 
ing as a president an individual who 
has both medical and _ psychological 
training we may be able to work out a 
program with the AMA. Our leader 
may succeed in obtaining for us from 
the AMA some sort of certification. 
We might call these medical psycho- 
logical technician certificates. In return 
we would promise to live by the follow- 
ing rules: 

1. That our organization become an 
affiliate of the AMA. 
2. That we continue to elect as a presi- 
dent an individual who has both 
medical and psychological training. 
That we practice psychology so that 
there be a minimum of friction with 
the medical profession. Thus, voca- 
uonal and educational guidance 
work as well as group therapy with 
children might be the exclusive 
right of the medical psychological 
technician. The medical psycholog- 


, 
we 
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ical technician might also accept 
adults with a mild emotional dis- 
turbance providing they are first 
examined by a physician who deter- 
mines whether or not psychiatric 
treatment is needed. Even in in- 
stances when the medical psycho- 
logical technician would be asked to 
treat a disturbed adult case the pa- 
tient would be instructed to return 
to his physician from time to time 
for a check-up. We might even con- 
sider a ruling holding that in in- 
stances when the mildly neurotic is 
being treated by a medical psycho- 
logical technician the latter func- 
tion in the capacity of an assistant 
to a physician. 

4+. That when practicing on a private 
basis the medical psychological tech- 
nician would establish his office in a 
medical center and that he would be- 
gin practicing only after having 
given the 4MA proof that he has a 
working relationship with a physi- 
cian and possibly a psychiatrist. 

5. That the 4.174 would need to certi- 
fy as medical psychological techni- 
cians only individuals who have the 
M.A. degree or two years of gradu- 
ate training in psychology and at 
least two years of experience in the 
field. 

I am hoping that psychologists, phy- 
sicians and psychiatrists will write to 
the author stating what they think 
about some such program as the above. 


MARSHALL C. GRECO 
Social Relations Office Aliquyspa, Pa. 
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SnypeR, WiLLttIAM U. Casebook of 


counseling. Boston: 


Mifflin, 1947, pp. 339. 


non-directive 
Houghton 
$3.00. 


Dr. Snyder is Assistant Professor of 
Psychology at Pennsylvania State Col- 


lege and Associate Director of its Psy- 
cho-Educational Clinic. This casebook 
includes detailed presentations of repre- 
sentative cases counseled by C. R. 
Rocers, G. A. Mvencu, A. W. 
Comps, V. M. AX LIne and the author. 
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These cases were selected to illustrate 
the applications of non-directive 
therapy to various problems and situ- 
ations. The most significant sequences 
in the counseling interviews are pre- 
sented verbatim with appropriate com- 
ments on technique included in foot- 
notes. For each case, one entire inter- 
view is further analysed with client and 
counselor statements being classified 
according to categories of response and 
feelings expressed. <A practice exer- 
cise is included in Appendix A consist- 
ing of an interview in which counselor 
responses are omitted so that the reader 
may gain practice in clarifying feelings 
by supplying his own responses and 
then comparing them with those made 
by an experienced counselor. Whether 
or not one agrees with the viewpoint 
of non-directive therapy, this casebook 
makes a unique contribution in objecti- 
fying practical procedures. It is the 
first psychological publication which 
illustrates many of the little technical 
points which the student has hitherto 
been able to acquire only by the ap- 
prenticeship method. It may be highly 
recommended for all students of clini- 
cal psychology. 


Harms, E. Handbook of child quid- 
ance. New York: Child Care Publi- 
cations, 1947, pp. 751. $8.50. 

Dr. Harms is well known as editor of 

The Nervous Child and as a practising 

child psychologist of wide repute. His 

personal orientation toward child guid- 
ance involves an imaginative dynamic 
attack upon the total problem, vigor- 
ously condemning reactionism wherever 
encountered, and striving constantly 
toward newer insights. In this Hand- 
book, he has gathered the work of 
more than 40 contributors, most of 
whom are known as leaders in their 
specialties. Part 1 presents an excellent 
summary by BERNARD GLUECK on the 
development of child guidance in the 

United States. Part 2 presents six ar- 

ticles on guidance of the normal child 


in the nursery age, kindergarten, ele- 
mentary school age, adolescence, in sec- 
ondary schools, and the superior child. 
The guidance of the physically handi- 
capped, and of the problem and’ sub- 
normal child is presented in parts 3 and 
4. Four articles dealing with the child 
guidance training of the medical physi- 
cian, psychiatrist, psychologist and so- 
cial worker are included in part 5. Part 
6 presents an interesting series of re- 
ports on the social aspects of child 
guidance, while part 7 discusses the re- 
ligious aspects from Roman Catholic, 
Protestant, Jewish and Quaker view- 
points. A concluding section presents 
the Freudian, Adlerian and Jungian 
viewpoints for child guidance. The in- 
dividual contributions in this Handbook 
are all of high calibre and reveal a 
continuity of purpose not usually found 
in books of this type. The orientation 
is genuinely eclectic and not over- 
weighted by material from the medical- 
psychiatric viewpoint. This is the best 
work on child guidance yet published. 


WexBercG, L. E. Introduction to medi- 
cal psychology. New York: Grune & 
Stratton, 1947. 

Formerly teacher of psychiatry at 

Louisiana State University School of 

Medicine and now  Directtor, Bu- 

reau of Mental Hygiene, District 

of Columbia, the author has col- 
lected his lectures to students of 
medical psychology in monograph 
form. Although the author is un- 
doubtedly well-read in psychology, his 
viewpoints are not always those of the 
experimental psychologist. The text 
consists of a series of essays written 
in a pseudoscientific style and involving 

a rehash of concepts gathered from all 

the principal schools of psychology. In 

a field where a basic text is greatly 

needed, this little book falls far short 

of the mark of making available the 
essence of modern psychology for 
medical personnel. 
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BOOK REVIEWS 105 


MerriLL, M. A. Problems of child de- 
linguency. Boston: Houghton Miffin, 
1927, pp. 403. $3.50. 

Dr. Merrill is professor of psychology 
at Stanford University, and an able 
student of child psychology. Approach- 
ing problems of delinquency from an 
eclectic viewpoint, this book is dedicated 
to a summary of relevant techniques 
and scientific research reports relating 
to delinquency. Approaching the study 
irom the viewpoint of the needs of the 
individual child, data are presented con- 
cerning all factors related to the cen- 
tral problem. This book is exceptionally 
well written. The material is well or- 
ganized with exceptionally clear tabular 
material. It is suited not only for the 
student but also for clinical psycholo- 
gists who deal even remotely with 
problems of delinquency. 


Anon. Current trends in psychology. 


Pittsburgh: University of. Pitts- 
burgh Press, 1947, pp. 225. $3.50. 


This is a compilation of eight lectures 
given by representative American psy- 
chologists in a symposium under the 
auspices of the University of Pitts- 
burgh on March 5-6, 1947. Chapters 
on clinical psychology, psychotherapy, 
personnel psychology and human engi- 
neering will be of interest to clinical 
psychologists. 


NAuUMBERG, M. Studies of the “free” 
art expression of behavior problem 
children and adolescents as a means 
of diagnosis and therapy. New York: 
Nervous and Mental Disease Mono- 
graphs, 1947, No. 71, pp. 225. $5.50. 

This monograph consists of six studies 

previously published elsewhere report- 

ing data gathered in a research study 
at the N. Y. State Psychiatric Insti- 
tute and Hospital on the possible use 


of “free” or spontaneous art expres- 
sion as aids to diagnosis and therapy. 
Detailed reports are included of the 
psychodynamics of art work in selected 
clinical cases. Typical drawings are 
reproduced in 99 illustrations which are 
of great interest. This monograph 
makes a notable contribution to the 
study of art expression in problem 
children. 


HARRIMAN, P. L. The new dictionary 
of psychology. New York: Philo- 
sophical Library, 1947, pp. 364. 
$5.00. 

The first new psychological dictionary 
in twenty years, this volume is particu- 
larly well designed for student use. 
Many obscure terms have been omitted, 
and definitions have been revised con- 
sistent with modern usage. Included 
are brief sketches of the great names 
in psychology and related fields with 
biographical dates. It is regretted that 
the high cost of this publication will 
prohibit its wide use by students. 


GILBERT, G. M. Nuremberg Diary. 
New York: Farrar, Strtaus & Co., 
1947, pp. 471. $5.00. 

Dr. Gilbert gives us a behind-the-scenes 

account of his experiences as prison 

psychologist at the Nuremberg trial of 

Nazi war criminals. Presented in the 

form of a diary, the reader is intro- 

duced to all of the major characters of 
the trial with a chronological account 
of occurrences and psychological reac- 
tions. Although valuable as anecdotal 
evidence concerning personal character- 
istics of the various Nazi leaders, one 
regrets that more evidence is not in- 
cluded concerning objective test results. 

This book may be regarded as an in- 

teresting bit of reporting rather than as 

a scientific’ study. 








ADVANCE NOTICE 
SYMPOSIUM ON NONDIRECTIVE COUNSELING 


By popular request, this Journal is sponsoring a symposium on 
nondirective methods of counseling which will be ready for publication 
in an early 1948 issue. It has been proposed by a number of clinical 
psychologists that important problems related to this system of therapy 
need further clarification. These questions relate to the responsibility 
of the counselor to the client, interprofessional relationships with other 
specialists, training responsibilities, and also the clarification of certain 
theoretical issues. 

The Editorial Board feels that it is highly desirable for these issues 
to be formulated and discussed by both proponents and critics of non- 
directive therapy. It has therefore invited a group of prominent 
clinical psychologists to pose a number of critical issues. For this 
special issue, Dr. Jerry W. Carter, Jr., Wichita Guidance Center, 3422 
E. Douglas Ave., Wichita 8, Kansas, has consented to cooperate as 
guest editor. Through this means it is hoped that an impartial forum 
will be constituted for the discussion of matters vital to our knowledge 
of the indications and contraindications of these new methods. Psy- 
chologists are invited to send Dr. Carter their suggestions as to major 
points which deserve to be considered in such a symposium. 











SPECIAL STUDENT RATES 


Beginning with the January 1948 issue, the special subscription rate 
available to members of the American Psychological Association will be 
extended to include all graduate students in psychology or related fields. 
Subscriptions will be accepted from all students at the rate of only $3.00 per 
annum. 


Complete sets of back volumes I, II and III will be available to students 
only at the reduced rate of $10.00 for the complete set. 
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